-- Logs begin at Thu 2022-08-04 04:11:09 UTC, end at Thu 2022-08-04 05:46:25 UTC. -- Aug 04 05:16:03.995830 dv-cinder-852072-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 04 05:16:04.003343 dv-cinder-852072-1-iscsi devstack@n-api.service[103948]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 04 05:16:04.007740 dv-cinder-852072-1-iscsi devstack@n-api.service[103948]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Aug 4 05:16:04 2022] *** Aug 04 05:16:04.007740 dv-cinder-852072-1-iscsi devstack@n-api.service[103948]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 04 05:16:04.007740 dv-cinder-852072-1-iscsi devstack@n-api.service[103948]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 04 05:16:04.007740 dv-cinder-852072-1-iscsi devstack@n-api.service[103948]: nodename: dv-cinder-852072-1-iscsi Aug 04 05:16:04.007740 dv-cinder-852072-1-iscsi devstack@n-api.service[103948]: machine: x86_64 Aug 04 05:16:04.007740 dv-cinder-852072-1-iscsi devstack@n-api.service[103948]: clock source: unix Aug 04 05:16:04.007740 dv-cinder-852072-1-iscsi devstack@n-api.service[103948]: pcre jit disabled Aug 04 05:16:04.007740 dv-cinder-852072-1-iscsi devstack@n-api.service[103948]: detected number of CPU cores: 4 Aug 04 05:16:04.007740 dv-cinder-852072-1-iscsi devstack@n-api.service[103948]: current working directory: / Aug 04 05:16:04.007740 dv-cinder-852072-1-iscsi devstack@n-api.service[103948]: detected binary path: /usr/bin/uwsgi-core Aug 04 05:16:04.007740 dv-cinder-852072-1-iscsi devstack@n-api.service[103948]: your processes number limit is 47680 Aug 04 05:16:04.007740 dv-cinder-852072-1-iscsi devstack@n-api.service[103948]: your memory page size is 4096 bytes Aug 04 05:16:04.007740 dv-cinder-852072-1-iscsi devstack@n-api.service[103948]: detected max file descriptor number: 2048 Aug 04 05:16:04.007740 dv-cinder-852072-1-iscsi devstack@n-api.service[103948]: lock engine: pthread robust mutexes Aug 04 05:16:04.008707 dv-cinder-852072-1-iscsi devstack@n-api.service[103948]: thunder lock: enabled Aug 04 05:16:04.008707 dv-cinder-852072-1-iscsi devstack@n-api.service[103948]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 04 05:16:04.008707 dv-cinder-852072-1-iscsi devstack@n-api.service[103948]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 04 05:16:04.050362 dv-cinder-852072-1-iscsi devstack@n-api.service[103948]: Python main interpreter initialized at 0x55a4e4dbd9c0 Aug 04 05:16:04.050362 dv-cinder-852072-1-iscsi devstack@n-api.service[103948]: python threads support enabled Aug 04 05:16:04.050362 dv-cinder-852072-1-iscsi devstack@n-api.service[103948]: your server socket listen backlog is limited to 100 connections Aug 04 05:16:04.050362 dv-cinder-852072-1-iscsi devstack@n-api.service[103948]: your mercy for graceful operations on workers is 90 seconds Aug 04 05:16:04.050843 dv-cinder-852072-1-iscsi devstack@n-api.service[103948]: mapped 403077 bytes (393 KB) for 2 cores Aug 04 05:16:04.051430 dv-cinder-852072-1-iscsi devstack@n-api.service[103948]: *** Operational MODE: preforking *** Aug 04 05:16:04.051765 dv-cinder-852072-1-iscsi devstack@n-api.service[103948]: *** uWSGI is running in multiple interpreter mode *** Aug 04 05:16:04.051765 dv-cinder-852072-1-iscsi devstack@n-api.service[103948]: spawned uWSGI master process (pid: 103948) Aug 04 05:16:04.051987 dv-cinder-852072-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 04 05:16:04.052592 dv-cinder-852072-1-iscsi devstack@n-api.service[103948]: spawned uWSGI worker 1 (pid: 103949, cores: 1) Aug 04 05:16:04.052923 dv-cinder-852072-1-iscsi devstack@n-api.service[103948]: spawned uWSGI worker 2 (pid: 103950, cores: 1) Aug 04 05:16:04.054024 dv-cinder-852072-1-iscsi devstack@n-api.service[103948]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 04 05:16:04.728250 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 04 05:16:04.740792 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 04 05:16:05.826969 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 04 05:16:05.826969 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: from cryptography.utils import int_from_bytes Aug 04 05:16:05.827610 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 04 05:16:05.827610 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: from cryptography.utils import int_from_bytes Aug 04 05:16:05.827994 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 04 05:16:05.827994 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: from cryptography.utils import int_from_bytes Aug 04 05:16:05.828107 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 04 05:16:05.828107 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: from cryptography.utils import int_from_bytes Aug 04 05:16:08.346398 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 04 05:16:08.347049 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 04 05:16:08.347143 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 04 05:16:08.347568 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 04 05:16:08.347731 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 04 05:16:08.347874 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 04 05:16:08.347874 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 04 05:16:08.348173 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 04 05:16:08.348319 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:16:08.348425 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 04 05:16:08.348512 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:16:08.348590 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 04 05:16:08.348775 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:16:08.348871 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:16:08.349095 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:16:08.349206 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:16:08.349422 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:16:08.349518 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:16:08.349733 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:16:08.349830 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:16:08.350090 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:16:08.350232 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:16:08.350444 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:16:08.350542 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:16:08.350737 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:16:08.350871 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:16:08.350992 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:16:08.351080 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:16:08.351310 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:16:08.351397 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:16:08.351643 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-852072-1-iscsi {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:16:08.351759 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:16:08.351961 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:16:08.352056 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:16:08.352268 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:16:08.352365 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-852072-1-iscsi {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:16:08.352575 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:16:08.352670 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:16:08.352895 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:16:08.352988 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:16:08.353198 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:16:08.353283 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:16:08.353518 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:16:08.353602 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:16:08.353820 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:16:08.353904 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:16:08.354145 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:16:08.354333 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:16:08.354492 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:16:08.354783 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:16:08.355012 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:16:08.355133 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:16:08.355330 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:16:08.355444 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:16:08.355641 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:16:08.355737 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:16:08.355957 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:16:08.356067 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:16:08.356298 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:16:08.356409 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:16:08.356612 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:16:08.356717 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:16:08.356928 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:16:08.357068 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:16:08.357219 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:16:08.357312 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:16:08.357528 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:16:08.357623 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:16:08.357850 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:16:08.357946 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-852072-1-iscsi {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:16:08.358160 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:16:08.358286 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:16:08.358576 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:16:08.358671 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-852072-1-iscsi {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:16:08.358890 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:16:08.359037 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:16:08.359207 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:16:08.359354 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:16:08.359524 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:16:08.359700 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:16:08.359911 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:16:08.360065 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:16:08.360247 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:16:08.360388 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:16:08.360633 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:16:08.360787 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:16:08.360932 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:16:08.361072 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:16:08.361215 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:16:08.361354 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:16:08.361499 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:16:08.361656 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:16:08.361827 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:16:08.361981 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:16:08.362404 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:16:08.362569 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:16:08.362715 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:16:08.362882 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:16:08.363532 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:16:08.363698 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:16:08.363841 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:16:08.363971 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:16:08.364112 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:16:08.364259 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:16:08.364410 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:16:08.364565 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:16:08.364707 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:16:08.364852 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:16:08.365016 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:16:08.365172 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:16:08.365325 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:16:08.365481 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:16:08.365628 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:16:08.365785 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:16:08.365926 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:16:08.366079 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:16:08.366237 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:16:08.366417 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:16:08.366562 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:16:08.366562 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:16:08.366844 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:16:08.366990 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:16:08.367138 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:16:08.367138 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:16:08.367370 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:16:08.367513 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:16:08.367645 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:16:08.367645 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:16:08.368029 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:16:08.368178 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:16:08.368302 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:16:08.368386 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:16:08.368463 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:16:08.368551 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:16:08.368630 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:16:08.368707 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:16:08.368877 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:16:08.368969 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:16:08.369178 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:16:08.369272 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:16:08.369486 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:16:08.369580 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:16:08.369794 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:16:08.369933 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:16:08.370102 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:16:08.370187 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:16:08.370427 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:16:08.370516 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:16:08.370747 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:16:08.370833 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:16:08.371068 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:16:08.371162 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.46 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:16:08.371380 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.46 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:16:08.371465 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:16:08.371684 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:16:08.371768 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:16:08.372010 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:16:08.372106 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:16:08.372330 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:16:08.372468 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.46 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:16:08.372637 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:16:08.372747 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.46 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:16:08.372957 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:16:08.373043 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:16:08.373274 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:16:08.373359 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:16:08.373579 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:16:08.373673 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:16:08.373882 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:16:08.373977 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:16:08.374185 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:16:08.374271 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:16:08.374527 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:16:08.374628 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:16:08.374859 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:16:08.374945 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:16:08.375162 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:16:08.375256 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:16:08.375410 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:16:08.375505 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:16:08.375707 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:16:08.375800 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:16:08.376009 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:16:08.376097 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:16:08.376324 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:16:08.376421 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:16:08.376626 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:16:08.376766 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:16:08.376929 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:16:08.377013 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:16:08.377229 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:16:08.377322 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:16:08.377532 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:16:08.377654 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:16:08.377827 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:16:08.377921 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:16:08.378128 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:16:08.378217 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:16:08.378451 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:16:08.378554 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:16:08.379371 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:16:08.379517 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:16:08.379676 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:16:08.379836 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:16:08.380013 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:16:08.380149 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:16:08.380231 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:16:08.380394 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:16:08.380533 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:16:08.380704 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:16:08.380834 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:16:08.381015 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:16:08.381149 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:16:08.381322 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:16:08.381466 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:16:08.381631 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:16:08.381769 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:16:08.381940 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:16:08.382069 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:16:08.382250 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:16:08.382400 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:16:08.382607 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:16:08.382738 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:16:08.382935 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:16:08.383029 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:16:08.383246 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:16:08.383347 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:16:08.383555 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:16:08.383647 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:16:08.383863 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:16:08.383978 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:16:08.384172 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:16:08.384281 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:16:08.384471 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:16:08.384562 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:16:08.384786 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:16:08.384878 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:16:08.385090 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:16:08.385190 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:16:08.385393 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:16:08.385493 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:16:08.385709 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:16:08.385799 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:16:08.386009 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:16:08.386108 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:16:08.386332 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:16:08.386425 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:16:08.386645 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:16:08.386737 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:16:08.386950 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:16:08.387042 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:16:08.387253 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:16:08.387391 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:16:08.387555 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:16:08.387646 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:16:08.387855 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:16:08.387947 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:16:08.388153 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:16:08.388252 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:16:08.388455 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:16:08.388560 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:16:08.388756 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:16:08.388847 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:16:08.389057 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:16:08.389156 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:16:08.389356 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:16:08.389457 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:16:08.389660 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:16:08.389749 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:16:08.389969 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:16:08.390061 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:16:08.390270 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:16:08.390469 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:16:08.390596 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:16:08.390703 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:16:08.391079 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:16:08.391399 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:16:08.391515 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:16:08.391617 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:16:08.391699 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.391776 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:16:08.391853 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.391931 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:16:08.392175 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.392264 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:16:08.392493 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:16:08.392628 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.392807 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:16:08.392898 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.393140 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.393226 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.393455 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.393548 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.393765 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.393850 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.394076 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.394163 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.394516 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.394669 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.394855 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.395105 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.395268 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.395355 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.395579 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.395666 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.395895 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.395990 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.396212 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.396299 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.396539 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.396633 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.396853 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.396948 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.397165 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.397261 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.397479 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.397566 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.397787 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.397886 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.398101 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.398192 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.398448 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.398543 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.398770 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.398867 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.399079 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.399237 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.399418 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.399508 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.399745 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.399840 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.400058 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.400185 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.400380 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.400474 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.400696 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.400793 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.401002 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.401139 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.401308 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.401397 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.401614 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.401701 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.401931 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.402016 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.402256 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.402357 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.402590 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.402714 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.402907 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.403003 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.403219 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.403314 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.403528 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.403617 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.403837 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.403922 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.404145 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.404233 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.404452 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.404540 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.404785 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.404870 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.405094 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.405192 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.405405 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.405528 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.405712 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.405800 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.406024 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.406118 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.406351 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.406442 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.406664 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.406751 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.406971 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.407070 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.407274 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.407369 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.407577 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.407671 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.407879 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.407974 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.408187 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.408281 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.408489 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.408582 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.408804 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.408908 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.409112 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.409196 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.409416 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.409502 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.409726 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.409874 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.410066 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.410240 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.410435 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.410599 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.410700 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.410928 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.411030 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.411242 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.411328 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.411566 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.411659 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.411874 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.411962 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.412176 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.412261 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.412487 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.412579 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.412790 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.412882 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.413099 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.413186 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.413414 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.413503 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.413714 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.413800 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.414280 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.414395 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.414612 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.414708 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.414920 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.415009 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.415227 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.415314 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.415533 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.415620 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.415841 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.415927 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.416146 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.416237 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.416457 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.416544 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.416764 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.416850 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.417073 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.417166 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.417389 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.417482 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.417697 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.417782 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.418021 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.418181 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.418403 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.418497 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.418671 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.418757 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.418973 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.419067 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.419280 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.419374 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.419583 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.419669 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.419885 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.419983 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.420187 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.420273 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.420491 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.420576 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.420791 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.420879 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.421092 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.421177 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.421392 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.421480 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.421695 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.421804 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.421992 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.422079 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.422337 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.422487 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.422638 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.422726 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.422943 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.423029 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.423243 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.423328 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.423542 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.423636 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.423849 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.423933 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.424170 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.424263 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.424481 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.424566 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.424790 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.424893 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.425098 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.425192 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.425929 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.426035 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.426255 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.426450 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.426602 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.426764 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.426886 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.426974 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.427195 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.427288 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.427501 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.427606 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.427808 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.427895 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.428134 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.428258 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.428441 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.428546 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.428756 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.428857 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.429065 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.429171 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.429385 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.429484 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.429694 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.429791 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.430010 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.430107 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.430369 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.430469 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.430649 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.430755 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.430963 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.431058 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.431313 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.431412 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.431606 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.431698 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.431925 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.432027 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.432232 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.432324 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.432542 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.432634 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.432853 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.432954 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.433163 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.433288 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.433470 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.433557 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.433776 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.433871 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.434090 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.434176 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.434419 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.434508 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.434736 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.434835 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.435043 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.435129 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.435356 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.435439 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.435659 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.435754 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.435973 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.436061 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.436273 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.436360 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.436583 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.436678 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.436891 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.436975 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.437221 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.437306 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.437526 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.437612 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.437832 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.437918 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.438137 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.438223 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.438468 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.438556 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.438779 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.438865 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.439088 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.439186 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.439392 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.439479 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.439696 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.439782 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.440004 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.440108 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.440316 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.440402 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.440623 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.440714 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.440931 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.441025 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.441787 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.441956 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.442110 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.442261 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.442480 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.442610 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.442711 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.442934 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.443020 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.443252 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.443338 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.443575 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.443662 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.443885 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.443980 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.444205 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.444300 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.444517 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.444664 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.444817 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.444904 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.445117 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.445212 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.445430 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.445515 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.445733 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.445818 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.446033 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.446133 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.446349 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.446440 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.446653 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.446740 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.446991 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.447091 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.447296 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.447384 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.447595 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.447683 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.447906 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.447995 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.448213 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.448297 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.448515 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.448599 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.448819 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.448913 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.449122 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.449207 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.449425 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.449512 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.449742 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.449830 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.450050 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.450136 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.450374 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.450463 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.450684 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.450773 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.450990 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.451078 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.451294 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.451388 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.451598 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.451686 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.451918 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.452017 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.452221 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.452317 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.452527 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.452620 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.452837 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.452930 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.453136 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.453277 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.453488 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.453598 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.453747 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.453834 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.454068 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.454350 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.454443 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.454678 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.454766 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.454995 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.455090 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.455299 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.455391 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.455609 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.455696 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.455923 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.456022 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.456255 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.456489 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.456575 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.456912 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.457068 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.457262 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.457431 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.457560 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.457644 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.457808 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.457902 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.458109 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.458204 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.458439 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.458528 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.458746 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.458833 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.459049 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.459149 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.459350 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.459451 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.459656 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.459764 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.459955 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.460075 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.460254 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.460386 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.460552 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.460703 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.460853 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.461011 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.461162 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.461320 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.461460 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.461627 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.461766 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.461947 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.462080 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.462259 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.462416 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.462597 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.462683 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.462902 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.462990 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.463209 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.463342 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.463542 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.463680 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.463839 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.463927 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.464155 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.464245 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.464460 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.464546 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.464786 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.464880 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.465097 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.465192 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.465403 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.465502 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.465702 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.465788 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.466005 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.466097 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.466326 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.466428 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.466627 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.466715 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.466928 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.467014 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.467232 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.467331 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.467536 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.467654 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.467837 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.467965 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.468144 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.468274 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.468449 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.468601 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.468753 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.468910 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.469056 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.469217 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.469352 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.469523 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.469654 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.469833 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.469953 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.470141 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.470261 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.470472 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.470586 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.470784 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.470882 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.471097 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.471182 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.471409 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.471497 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.471719 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.471881 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.472029 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.472139 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.472898 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.473030 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.473192 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.473343 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.473547 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.473814 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.473901 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.474121 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.474216 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.474448 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.474539 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.474753 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.474828 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.475061 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.475151 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.475365 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.475439 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.475667 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.475761 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.475971 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.476065 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.476285 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.476370 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.476588 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.476722 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.476890 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.476978 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.477192 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.477285 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.477492 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.477578 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.477794 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.477881 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.478097 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.478183 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.478437 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.478525 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.478751 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.478838 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.479048 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.479143 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.479353 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.479440 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.479654 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.479742 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.479956 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.480050 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.480256 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.480350 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.480560 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.480646 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.480857 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.480951 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.481157 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.481254 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.481456 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.481542 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.481756 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.481850 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.482058 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.482167 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.482388 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.482486 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.482691 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.482790 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.482992 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.483096 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.483291 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.483382 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.483595 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.483688 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.483906 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.483995 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.484213 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.484300 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.484519 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.484611 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.484845 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.484939 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.485154 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.485240 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.485459 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.485552 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.485764 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.485851 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.486070 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.486154 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.486439 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.486529 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.486749 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.486837 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.487058 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.487153 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.487365 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.487461 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.487674 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.487760 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.488603 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.488737 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.488938 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.489106 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.489256 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.489363 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.489555 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.489642 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.489864 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.489960 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.490183 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.490270 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.490542 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.490630 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.490862 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.490961 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.491162 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.491248 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.491466 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.491558 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.491771 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.491873 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.492075 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.492169 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.492647 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.492762 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.492849 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.492928 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.492998 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.493064 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.493274 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.493364 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.493583 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.493681 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.493888 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.494017 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.494195 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.494281 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.494521 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.494611 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.494826 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.494913 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.495130 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.495216 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.495430 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.495526 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.495741 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.495827 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.496045 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.496138 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.496346 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.496432 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.496649 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.496736 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.496949 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.497044 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.497256 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.497342 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.497556 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.497647 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.497861 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.497984 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.498190 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.498276 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.498543 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.498634 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.498853 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.498953 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.499169 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.499257 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.499480 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.499567 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.499790 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.499876 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.500096 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.500181 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.500399 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.500527 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.500808 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.500896 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.501116 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.501208 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.501420 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.501508 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.501725 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.501815 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.502024 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.502111 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.502354 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.502444 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.502646 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.502736 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.502958 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.503051 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.503256 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.503375 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.503643 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.503802 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.503954 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.504095 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.504244 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.504390 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.504637 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.504726 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.504947 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.505032 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.505257 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.505353 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.505588 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.505724 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.505892 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.505979 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.506199 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.506361 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.506543 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.506671 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.506865 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.506986 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.507171 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.507266 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.507493 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.507579 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.507893 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.507978 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.508193 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.508281 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.508501 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.508587 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.508806 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.508915 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.509126 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.509214 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.509448 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.509571 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.509756 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.509844 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.510065 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.510152 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.510388 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.510481 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.510711 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.510819 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.511029 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.511116 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.511339 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.511427 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.511658 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.511744 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.512000 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.512159 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.512315 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.512403 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.512632 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.512718 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.512939 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.513048 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.513267 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.513355 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.513571 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.513664 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.513872 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.513972 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.514177 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.514271 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.514500 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.514644 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.514799 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.514974 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.515116 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.515287 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.515416 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.515612 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.515713 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.515937 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.516030 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.516280 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.516365 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.516588 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.516682 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.516881 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.516967 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.517193 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.517267 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.517489 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.517582 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.517844 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.517939 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.518112 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.518198 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.518447 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.518550 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.518767 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.518868 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.519066 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.519153 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.519479 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.519623 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.519786 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.519952 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.520214 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.520306 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.520520 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.520608 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.520822 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.520909 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.521164 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.521250 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.521467 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.521555 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.521783 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.521877 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.522112 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.522198 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.522466 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.522557 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.522838 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.522937 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.523080 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.523180 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.523389 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.523489 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.523695 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.523790 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.524020 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.524121 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.524340 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.524426 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.524642 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.524735 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.524941 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.525037 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.525247 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.525334 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.525547 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.525642 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.525848 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.525943 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.526148 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.526235 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.526476 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.526567 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.526777 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.526872 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.527074 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.527168 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.527372 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.527466 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.527689 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.527777 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.527990 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.528078 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.528308 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.528401 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.528611 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.528707 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.528911 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.528998 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.529209 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.529299 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.529508 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.529596 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.529808 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.529907 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.530115 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.530209 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.530464 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.530553 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.530773 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.530858 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.531094 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.531192 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.531406 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.531493 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.531713 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.531800 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.532020 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.532115 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.532326 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.532412 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.532635 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.532777 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.532949 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.533075 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.533261 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.533394 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.533569 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.533657 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.533880 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.533969 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.534188 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.534285 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.534524 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.534614 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.535450 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.535602 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.535887 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.536263 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.536368 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.536467 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.536559 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.536745 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.536873 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.537062 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.537189 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.537377 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.537510 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.537689 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.537827 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.538001 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.538147 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.538366 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.538649 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.538784 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.539222 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.539335 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.539540 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.539637 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.539863 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.539965 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.540185 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.540273 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.540509 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.540605 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.540827 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.540927 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.541134 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.541240 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.541446 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.541545 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.541754 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.541841 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.542066 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.542151 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.542422 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.542514 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.542730 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.542822 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.543046 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.543176 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.543361 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.543460 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.543676 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.543763 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.543984 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.544086 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.544292 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.544383 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.544601 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.544771 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.544909 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.545011 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.545217 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.545313 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.545524 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.545623 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.545832 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.545920 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.546141 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.546228 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.546487 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.546577 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.546800 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.546894 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.547115 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.547202 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.547423 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.547557 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.547734 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.547820 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.548047 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.548132 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.548361 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.548566 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.548677 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.548882 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.548994 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.549217 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.549304 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.549543 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.549638 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.549867 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.549961 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.550179 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.550267 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.550608 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.550742 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.551041 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.551193 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.551382 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.551565 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.551707 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.551887 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.551974 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.552227 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.552315 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.552561 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.552649 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.552880 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.552993 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.553238 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.553328 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.553474 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.553562 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.553794 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.553880 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.554100 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.554187 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.554451 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.554659 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.554774 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.555005 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.555092 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.555318 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.555431 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.555644 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.555762 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.555964 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.556054 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.556281 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.556369 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.556586 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.556675 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.556904 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.556991 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.557207 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.557483 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.557614 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.557810 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.557907 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.558119 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.558214 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.558442 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.558533 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.558749 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.558855 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.559055 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.559144 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.559360 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.559447 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.559663 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.559751 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.559969 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.560062 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.560269 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.560357 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.560589 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.560678 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.560892 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.560980 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.561192 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.561279 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.561491 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.561591 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.561799 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.561888 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.562097 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.562185 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.562419 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.562522 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.562723 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.562818 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.563021 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.563109 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.563329 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.563436 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.563626 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.563714 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.563934 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.564030 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.564236 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.564336 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.564542 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.564637 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.564842 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.564929 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.565145 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.565239 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.565445 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.565531 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.565751 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.565836 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.566600 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.566758 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.566955 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.567088 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.567276 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.567427 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.567578 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.567731 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.567890 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.568039 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.568183 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.568326 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.568487 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.568651 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.568796 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.568951 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.569098 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.569306 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.569460 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.569665 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.569821 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.569998 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.570149 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.570403 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.570570 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.570729 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.570889 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.571034 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.571173 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.571337 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.571485 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.571697 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.571847 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.571994 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.572140 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.572395 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.572558 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.572706 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.572854 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.573012 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.573185 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.573334 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.573587 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.573739 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.573898 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.574059 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.574216 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.574387 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.574588 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.574730 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.574861 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.575007 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.575174 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.575339 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.575434 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.575525 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.575613 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.575693 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.575781 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.575929 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.576017 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.576242 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.576328 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.576550 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.576645 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.576859 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.576944 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.577176 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.577262 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.577489 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.577578 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.577842 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.577941 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.578104 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.578189 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.578437 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.578540 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.578746 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.578833 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.579054 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.579149 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.579361 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.579448 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.579673 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.579761 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.580000 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.580097 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.580312 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.580407 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.580614 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.580702 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.580931 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.581027 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.581251 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.581347 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.581566 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.581764 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.582589 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.582747 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.582899 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.583018 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.583201 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.583290 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.583519 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.583613 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.583827 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.583915 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.584151 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.584238 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.584459 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.584547 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.584785 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.584872 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.585122 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.585218 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.585448 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.585535 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.585772 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.585860 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.586077 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.586173 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.586408 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.586512 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.586712 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.586799 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.587020 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.587117 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.587334 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.587421 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.587640 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.587726 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.587950 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.588051 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.588238 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.588325 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.588544 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.588639 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.588843 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.588957 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.589142 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.589269 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.589442 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.589580 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.589741 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.589889 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.590044 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.590202 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.590365 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.590560 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.590659 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.590874 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.590963 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.591184 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.591272 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.591493 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.591580 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.591804 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.591897 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.592104 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.592197 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.592403 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.592491 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.592700 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.592788 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.592997 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.593085 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.593297 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.593386 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.593598 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.593735 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.593900 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.593987 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.594205 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.594294 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.594538 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.594627 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.594847 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.594947 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.595156 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.595250 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.595471 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.595557 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.595777 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.595872 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.596085 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.596172 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.596390 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.596484 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.596697 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.596791 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.596999 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.597085 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.597347 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.597494 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.597638 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.597922 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.598103 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.598222 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.598413 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.598546 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.598650 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.598845 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.598935 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.599151 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.599240 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.599474 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.599616 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.599795 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.599884 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.600097 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.600184 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.600416 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.600512 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.600727 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.600814 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.601042 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.601129 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.601354 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.601456 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.601660 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.601796 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.601972 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.602058 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.602279 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.602437 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.602608 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.602707 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.602912 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.603001 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.603218 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.603314 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.603523 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.603616 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.603832 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.603927 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.604140 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.604227 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.604444 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.604530 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.604754 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.604896 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.605063 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.605158 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.605381 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.605474 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.605701 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.605796 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.606006 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.606100 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.606337 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.606426 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.606658 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.606764 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.606976 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.607063 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.607288 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.607375 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.607607 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.607695 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.607921 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.608015 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.608235 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.608328 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.608544 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.608643 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.608844 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.608939 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.609084 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 04 05:16:08.609171 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.609491 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.609806 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.610139 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.610499 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.610853 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.611171 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.611520 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.611858 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.612179 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.612494 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.612803 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:16:08.613111 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 04 05:16:08.767512 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: INFO dbcounter [None req-f81db8f8-aa0d-4c39-8510-126d9fc46337 None None] Registered counter for database nova_api Aug 04 05:16:08.769672 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: INFO dbcounter [None req-60f48f58-ee6f-4d19-8544-0ef5795b025d None None] Registered counter for database nova_api Aug 04 05:16:08.789353 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG oslo_db.sqlalchemy.engines [None req-f81db8f8-aa0d-4c39-8510-126d9fc46337 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103950) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 04 05:16:08.792297 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG oslo_db.sqlalchemy.engines [None req-60f48f58-ee6f-4d19-8544-0ef5795b025d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103949) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 04 05:16:08.796068 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG dbcounter [-] [103950] Writer thread running {{(pid=103950) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 04 05:16:08.799035 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG dbcounter [-] [103949] Writer thread running {{(pid=103949) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 04 05:16:08.854898 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.context [None req-f81db8f8-aa0d-4c39-8510-126d9fc46337 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),36d37866-0ef0-448b-8699-3d2b86be0706(cell1) {{(pid=103950) load_cells /opt/stack/nova/nova/context.py:464}} Aug 04 05:16:08.858740 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.context [None req-60f48f58-ee6f-4d19-8544-0ef5795b025d None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),36d37866-0ef0-448b-8699-3d2b86be0706(cell1) {{(pid=103949) load_cells /opt/stack/nova/nova/context.py:464}} Aug 04 05:16:08.858897 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG oslo_concurrency.lockutils [None req-f81db8f8-aa0d-4c39-8510-126d9fc46337 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:16:08.860497 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG oslo_concurrency.lockutils [None req-f81db8f8-aa0d-4c39-8510-126d9fc46337 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:16:08.861291 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG oslo_concurrency.lockutils [None req-f81db8f8-aa0d-4c39-8510-126d9fc46337 None None] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:16:08.862725 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG oslo_concurrency.lockutils [None req-60f48f58-ee6f-4d19-8544-0ef5795b025d None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:16:08.863883 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG oslo_concurrency.lockutils [None req-f81db8f8-aa0d-4c39-8510-126d9fc46337 None None] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:16:08.864977 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG oslo_concurrency.lockutils [None req-60f48f58-ee6f-4d19-8544-0ef5795b025d None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:16:08.865799 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG oslo_concurrency.lockutils [None req-60f48f58-ee6f-4d19-8544-0ef5795b025d None None] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:16:08.865981 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: INFO dbcounter [None req-f81db8f8-aa0d-4c39-8510-126d9fc46337 None None] Registered counter for database nova_cell0 Aug 04 05:16:08.867843 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG oslo_concurrency.lockutils [None req-60f48f58-ee6f-4d19-8544-0ef5795b025d None None] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:16:08.869979 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: INFO dbcounter [None req-60f48f58-ee6f-4d19-8544-0ef5795b025d None None] Registered counter for database nova_cell0 Aug 04 05:16:08.871582 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: INFO dbcounter [None req-f81db8f8-aa0d-4c39-8510-126d9fc46337 None None] Registered counter for database nova_cell1 Aug 04 05:16:08.876183 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: INFO dbcounter [None req-60f48f58-ee6f-4d19-8544-0ef5795b025d None None] Registered counter for database nova_cell1 Aug 04 05:16:08.879665 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG oslo_db.sqlalchemy.engines [None req-f81db8f8-aa0d-4c39-8510-126d9fc46337 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103950) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 04 05:16:08.882353 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG oslo_db.sqlalchemy.engines [None req-f81db8f8-aa0d-4c39-8510-126d9fc46337 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103950) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 04 05:16:08.884312 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG oslo_db.sqlalchemy.engines [None req-60f48f58-ee6f-4d19-8544-0ef5795b025d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103949) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 04 05:16:08.885669 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG oslo_db.sqlalchemy.engines [None req-60f48f58-ee6f-4d19-8544-0ef5795b025d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103949) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 04 05:16:08.888614 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG dbcounter [-] [103950] Writer thread running {{(pid=103950) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 04 05:16:08.890905 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG dbcounter [-] [103950] Writer thread running {{(pid=103950) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 04 05:16:08.893075 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG dbcounter [-] [103949] Writer thread running {{(pid=103949) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 04 05:16:08.893433 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG dbcounter [-] [103949] Writer thread running {{(pid=103949) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 04 05:16:09.039292 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: INFO dbcounter [None req-f81db8f8-aa0d-4c39-8510-126d9fc46337 None None] Registered counter for database nova_cell0 Aug 04 05:16:09.046093 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG oslo_db.sqlalchemy.engines [None req-f81db8f8-aa0d-4c39-8510-126d9fc46337 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103950) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 04 05:16:09.049305 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: INFO dbcounter [None req-60f48f58-ee6f-4d19-8544-0ef5795b025d None None] Registered counter for database nova_cell0 Aug 04 05:16:09.052230 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG dbcounter [-] [103950] Writer thread running {{(pid=103950) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 04 05:16:09.057324 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG oslo_db.sqlalchemy.engines [None req-60f48f58-ee6f-4d19-8544-0ef5795b025d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103949) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 04 05:16:09.062008 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG dbcounter [-] [103949] Writer thread running {{(pid=103949) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 04 05:16:09.477864 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: WARNING keystonemiddleware.auth_token [None req-f81db8f8-aa0d-4c39-8510-126d9fc46337 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 04 05:16:09.485078 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: WARNING keystonemiddleware.auth_token [None req-f81db8f8-aa0d-4c39-8510-126d9fc46337 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 04 05:16:09.515086 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: WARNING keystonemiddleware.auth_token [None req-60f48f58-ee6f-4d19-8544-0ef5795b025d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 04 05:16:09.523119 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: WARNING keystonemiddleware.auth_token [None req-60f48f58-ee6f-4d19-8544-0ef5795b025d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 04 05:16:09.840383 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: WARNING keystonemiddleware.auth_token [None req-f81db8f8-aa0d-4c39-8510-126d9fc46337 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 04 05:16:09.846270 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: WARNING keystonemiddleware.auth_token [None req-f81db8f8-aa0d-4c39-8510-126d9fc46337 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 04 05:16:09.852680 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55a4e4dbd9c0 pid: 103950 (default app) Aug 04 05:16:09.854782 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi [None req-f81db8f8-aa0d-4c39-8510-126d9fc46337 None None] Calling method '>' {{(pid=103950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:16:09.855936 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: INFO nova.api.openstack.requestlog [None req-f81db8f8-aa0d-4c39-8510-126d9fc46337 None None] 10.222.0.46 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001709 Aug 04 05:16:09.856344 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: [pid: 103950|app: 0|req: 1/1] 10.222.0.46 () {50 vars in 788 bytes} [Thu Aug 4 05:16:09 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:16:09.869898 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: WARNING keystonemiddleware.auth_token [None req-60f48f58-ee6f-4d19-8544-0ef5795b025d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 04 05:16:09.875948 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: WARNING keystonemiddleware.auth_token [None req-60f48f58-ee6f-4d19-8544-0ef5795b025d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 04 05:16:09.881352 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55a4e4dbd9c0 pid: 103949 (default app) Aug 04 05:17:30.750895 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi [None req-f81db8f8-aa0d-4c39-8510-126d9fc46337 None None] Calling method '>' {{(pid=103950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:17:30.751905 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: INFO nova.api.openstack.requestlog [None req-f81db8f8-aa0d-4c39-8510-126d9fc46337 None None] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001542 Aug 04 05:17:30.752473 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: [pid: 103950|app: 0|req: 2/2] 10.222.0.46 () {54 vars in 931 bytes} [Thu Aug 4 05:17:30 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:17:30.771470 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG dbcounter [-] [103949] Writing DB stats nova_api:SELECT=3 {{(pid=103949) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:17:30.772622 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG dbcounter [-] [103949] Writing DB stats nova_cell1:SELECT=3 {{(pid=103949) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:17:30.773749 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG dbcounter [-] [103949] Writing DB stats nova_cell0:SELECT=3 {{(pid=103949) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:17:30.774750 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG dbcounter [-] [103949] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103949) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:17:31.696328 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi [None req-f3ed0166-3d8b-45dc-8088-e6ae18a31ed3 admin admin] Calling method '>' {{(pid=103949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:17:31.728497 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: INFO nova.api.openstack.requestlog [None req-f3ed0166-3d8b-45dc-8088-e6ae18a31ed3 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.967684 Aug 04 05:17:31.729243 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: [pid: 103949|app: 0|req: 1/3] 10.222.0.46 () {60 vars in 1292 bytes} [Thu Aug 4 05:17:30 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 970 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:17:34.198788 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi [None req-f81db8f8-aa0d-4c39-8510-126d9fc46337 None None] Calling method '>' {{(pid=103950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:17:34.200422 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: INFO nova.api.openstack.requestlog [None req-f81db8f8-aa0d-4c39-8510-126d9fc46337 None None] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002318 Aug 04 05:17:34.201104 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: [pid: 103950|app: 0|req: 3/4] 10.222.0.46 () {54 vars in 931 bytes} [Thu Aug 4 05:17:34 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:17:34.810142 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi [None req-10590809-11f4-472f-9c26-821d36d26be0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "disk": 1, "vcpus": 1, "name": "cirros256", "OS-FLV-EXT-DATA:ephemeral": 0, "id": "c1", "swap": 0, "ram": 256, "os-flavor-access:is_public": true}} {{(pid=103949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:17:34.850897 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 05:17:34.850897 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: warnings.warn(msg) Aug 04 05:17:34.974425 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: INFO nova.api.openstack.requestlog [None req-10590809-11f4-472f-9c26-821d36d26be0 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.760202 Aug 04 05:17:34.983499 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: [pid: 103949|app: 0|req: 2/5] 10.222.0.46 () {64 vars in 1283 bytes} [Thu Aug 4 05:17:34 2022] POST /compute/v2.1/flavors => generated 407 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 05:17:34.991425 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG dbcounter [-] [103950] Writing DB stats nova_api:SELECT=3 {{(pid=103950) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:17:34.992281 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG dbcounter [-] [103950] Writing DB stats nova_cell0:SELECT=3 {{(pid=103950) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:17:34.993318 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG dbcounter [-] [103950] Writing DB stats nova_cell1:SELECT=3 {{(pid=103950) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:17:34.994271 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG dbcounter [-] [103950] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103950) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:17:35.242436 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi [None req-f37ffc8b-68e7-4ccc-b87f-839aa6aa33f0 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:17:35.248261 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 05:17:35.248261 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: warnings.warn(msg) Aug 04 05:17:35.414647 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: INFO nova.api.openstack.requestlog [None req-f37ffc8b-68e7-4ccc-b87f-839aa6aa33f0 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.425263 Aug 04 05:17:35.414647 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: [pid: 103950|app: 0|req: 4/6] 10.222.0.46 () {64 vars in 1336 bytes} [Thu Aug 4 05:17:34 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:17:37.783874 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi [None req-10590809-11f4-472f-9c26-821d36d26be0 admin admin] Calling method '>' {{(pid=103949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:17:37.784951 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: INFO nova.api.openstack.requestlog [None req-10590809-11f4-472f-9c26-821d36d26be0 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001484 Aug 04 05:17:37.785380 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: [pid: 103949|app: 0|req: 3/7] 10.222.0.46 () {54 vars in 931 bytes} [Thu Aug 4 05:17:37 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:17:38.540933 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi [None req-03141ea1-062e-4634-bcb6-67705d1d553b admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d1", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "swap": 0, "disk": 5, "ram": 512, "os-flavor-access:is_public": true, "vcpus": 1, "name": "ds512M"}} {{(pid=103950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:17:38.561426 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 05:17:38.561426 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: warnings.warn(msg) Aug 04 05:17:38.697267 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: INFO nova.api.openstack.requestlog [None req-03141ea1-062e-4634-bcb6-67705d1d553b admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.904590 Aug 04 05:17:38.698158 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: [pid: 103950|app: 0|req: 5/8] 10.222.0.46 () {64 vars in 1283 bytes} [Thu Aug 4 05:17:37 2022] POST /compute/v2.1/flavors => generated 404 bytes in 906 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 04 05:17:38.710237 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi [None req-30d12cff-0904-4a11-9bec-783d3f7d9da4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:17:38.713292 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 05:17:38.713292 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: warnings.warn(msg) Aug 04 05:17:38.843217 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: INFO nova.api.openstack.requestlog [None req-30d12cff-0904-4a11-9bec-783d3f7d9da4 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.136300 Aug 04 05:17:38.844661 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: [pid: 103949|app: 0|req: 4/9] 10.222.0.46 () {64 vars in 1336 bytes} [Thu Aug 4 05:17:38 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:17:41.246183 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi [None req-03141ea1-062e-4634-bcb6-67705d1d553b admin admin] Calling method '>' {{(pid=103950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:17:41.247369 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: INFO nova.api.openstack.requestlog [None req-03141ea1-062e-4634-bcb6-67705d1d553b admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001547 Aug 04 05:17:41.252712 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: [pid: 103950|app: 0|req: 6/10] 10.222.0.46 () {54 vars in 931 bytes} [Thu Aug 4 05:17:41 2022] GET /compute/v2.1 => generated 388 bytes in 8 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:17:41.725292 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi [None req-2e6a3e76-66b2-4857-a4d1-ce112bbd63c4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "id": "d2", "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds1G", "swap": 0, "rxtx_factor": 1.0, "ram": 1024, "disk": 10, "os-flavor-access:is_public": true}} {{(pid=103949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:17:41.809932 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: INFO nova.api.openstack.requestlog [None req-2e6a3e76-66b2-4857-a4d1-ce112bbd63c4 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.555793 Aug 04 05:17:41.810719 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: [pid: 103949|app: 0|req: 5/11] 10.222.0.46 () {64 vars in 1283 bytes} [Thu Aug 4 05:17:41 2022] POST /compute/v2.1/flavors => generated 404 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 04 05:17:41.831190 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi [None req-0ebd3b08-d568-4781-bc2f-7412a316bdf4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:17:41.967395 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: INFO nova.api.openstack.requestlog [None req-0ebd3b08-d568-4781-bc2f-7412a316bdf4 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.142035 Aug 04 05:17:41.968103 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: [pid: 103950|app: 0|req: 7/12] 10.222.0.46 () {64 vars in 1336 bytes} [Thu Aug 4 05:17:41 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 05:17:44.308911 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi [None req-2e6a3e76-66b2-4857-a4d1-ce112bbd63c4 admin admin] Calling method '>' {{(pid=103949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:17:44.310040 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: INFO nova.api.openstack.requestlog [None req-2e6a3e76-66b2-4857-a4d1-ce112bbd63c4 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001703 Aug 04 05:17:44.310497 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: [pid: 103949|app: 0|req: 6/13] 10.222.0.46 () {54 vars in 931 bytes} [Thu Aug 4 05:17:44 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 05:17:45.002521 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi [None req-949aaede-31f7-4b96-84f7-22752f1476fc admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 2, "rxtx_factor": 1.0, "swap": 0, "ram": 2048, "os-flavor-access:is_public": true, "id": "d3", "name": "ds2G", "disk": 10}} {{(pid=103950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:17:45.287474 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: INFO nova.api.openstack.requestlog [None req-949aaede-31f7-4b96-84f7-22752f1476fc admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.969585 Aug 04 05:17:45.288872 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: [pid: 103950|app: 0|req: 8/14] 10.222.0.46 () {64 vars in 1283 bytes} [Thu Aug 4 05:17:44 2022] POST /compute/v2.1/flavors => generated 404 bytes in 972 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 04 05:17:45.301739 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi [None req-fc2a22b3-2f3b-4fe0-b305-d4a45668c380 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:17:45.424730 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: INFO nova.api.openstack.requestlog [None req-fc2a22b3-2f3b-4fe0-b305-d4a45668c380 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.127309 Aug 04 05:17:45.436904 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: [pid: 103949|app: 0|req: 7/15] 10.222.0.46 () {64 vars in 1336 bytes} [Thu Aug 4 05:17:45 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 05:17:47.859584 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi [None req-949aaede-31f7-4b96-84f7-22752f1476fc admin admin] Calling method '>' {{(pid=103950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:17:47.860626 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: INFO nova.api.openstack.requestlog [None req-949aaede-31f7-4b96-84f7-22752f1476fc admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001472 Aug 04 05:17:47.861066 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: [pid: 103950|app: 0|req: 9/16] 10.222.0.46 () {54 vars in 931 bytes} [Thu Aug 4 05:17:47 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:17:48.762495 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi [None req-cd811a93-2cd2-4800-98d0-d3b041a51dfc admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds4G", "disk": 20, "swap": 0, "vcpus": 4, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d4", "ram": 4096}} {{(pid=103949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:17:48.860993 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: INFO nova.api.openstack.requestlog [None req-cd811a93-2cd2-4800-98d0-d3b041a51dfc admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.990569 Aug 04 05:17:48.861944 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: [pid: 103949|app: 0|req: 8/17] 10.222.0.46 () {64 vars in 1283 bytes} [Thu Aug 4 05:17:47 2022] POST /compute/v2.1/flavors => generated 404 bytes in 993 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 05:17:48.886369 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi [None req-8a4c2bf9-d723-4258-b0ea-f8480a814278 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:17:49.002779 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: INFO nova.api.openstack.requestlog [None req-8a4c2bf9-d723-4258-b0ea-f8480a814278 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.125510 Aug 04 05:17:49.004016 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: [pid: 103950|app: 0|req: 10/18] 10.222.0.46 () {64 vars in 1336 bytes} [Thu Aug 4 05:17:48 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:17:51.538291 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi [None req-cd811a93-2cd2-4800-98d0-d3b041a51dfc admin admin] Calling method '>' {{(pid=103949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:17:51.539344 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: INFO nova.api.openstack.requestlog [None req-cd811a93-2cd2-4800-98d0-d3b041a51dfc admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001781 Aug 04 05:17:51.539759 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: [pid: 103949|app: 0|req: 9/19] 10.222.0.46 () {54 vars in 931 bytes} [Thu Aug 4 05:17:51 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 05:17:52.070687 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi [None req-c8003680-1ddb-4b2f-bed2-85517051d08c admin admin] Calling method '>' {{(pid=103950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:17:52.097122 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: INFO nova.api.openstack.requestlog [None req-c8003680-1ddb-4b2f-bed2-85517051d08c admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.544841 Aug 04 05:17:52.097952 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: [pid: 103950|app: 0|req: 11/20] 10.222.0.46 () {60 vars in 1292 bytes} [Thu Aug 4 05:17:51 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 05:17:54.530644 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi [None req-cd811a93-2cd2-4800-98d0-d3b041a51dfc admin admin] Calling method '>' {{(pid=103949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:17:54.531685 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: INFO nova.api.openstack.requestlog [None req-cd811a93-2cd2-4800-98d0-d3b041a51dfc admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001520 Aug 04 05:17:54.532110 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: [pid: 103949|app: 0|req: 10/21] 10.222.0.46 () {54 vars in 931 bytes} [Thu Aug 4 05:17:54 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:17:55.148854 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi [None req-aa7103b9-43fb-44bd-bfab-822c226a5cc8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "swap": 0, "id": "1", "rxtx_factor": 1.0, "vcpus": 1, "os-flavor-access:is_public": true, "name": "m1.tiny", "disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:17:55.244916 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: INFO nova.api.openstack.requestlog [None req-aa7103b9-43fb-44bd-bfab-822c226a5cc8 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.705041 Aug 04 05:17:55.245511 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: [pid: 103950|app: 0|req: 12/22] 10.222.0.46 () {64 vars in 1283 bytes} [Thu Aug 4 05:17:54 2022] POST /compute/v2.1/flavors => generated 402 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 05:17:55.260248 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi [None req-60387139-dea5-4ac8-9a8a-d054e650f46e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:17:55.357263 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: INFO nova.api.openstack.requestlog [None req-60387139-dea5-4ac8-9a8a-d054e650f46e admin admin] 10.222.0.46 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.100854 Aug 04 05:17:55.357886 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: [pid: 103949|app: 0|req: 11/23] 10.222.0.46 () {64 vars in 1333 bytes} [Thu Aug 4 05:17:55 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:17:57.802584 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi [None req-aa7103b9-43fb-44bd-bfab-822c226a5cc8 admin admin] Calling method '>' {{(pid=103950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:17:57.803982 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: INFO nova.api.openstack.requestlog [None req-aa7103b9-43fb-44bd-bfab-822c226a5cc8 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002153 Aug 04 05:17:57.804645 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: [pid: 103950|app: 0|req: 13/24] 10.222.0.46 () {54 vars in 931 bytes} [Thu Aug 4 05:17:57 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 05:17:58.261673 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi [None req-c05fdb10-ae6c-49b0-b78d-f4b9f48e8bba admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "2", "vcpus": 1, "swap": 0, "rxtx_factor": 1.0, "ram": 2048, "disk": 20, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.small"}} {{(pid=103949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:17:58.364249 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: INFO nova.api.openstack.requestlog [None req-c05fdb10-ae6c-49b0-b78d-f4b9f48e8bba admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.552181 Aug 04 05:17:58.365201 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: [pid: 103949|app: 0|req: 12/25] 10.222.0.46 () {64 vars in 1283 bytes} [Thu Aug 4 05:17:57 2022] POST /compute/v2.1/flavors => generated 405 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 05:17:58.377795 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi [None req-a9aad2b1-6413-4514-98ac-978f9ea348be admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:17:58.488494 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: INFO nova.api.openstack.requestlog [None req-a9aad2b1-6413-4514-98ac-978f9ea348be admin admin] 10.222.0.46 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.113680 Aug 04 05:17:58.489374 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: [pid: 103950|app: 0|req: 14/26] 10.222.0.46 () {64 vars in 1333 bytes} [Thu Aug 4 05:17:58 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:18:01.084693 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi [None req-c05fdb10-ae6c-49b0-b78d-f4b9f48e8bba admin admin] Calling method '>' {{(pid=103949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:18:01.087666 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: INFO nova.api.openstack.requestlog [None req-c05fdb10-ae6c-49b0-b78d-f4b9f48e8bba admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.003354 Aug 04 05:18:01.088875 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: [pid: 103949|app: 0|req: 13/27] 10.222.0.46 () {54 vars in 931 bytes} [Thu Aug 4 05:18:01 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:18:01.779789 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi [None req-5e74d79f-bba0-48ee-8469-2d14989356bc admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 4096, "disk": 40, "rxtx_factor": 1.0, "id": "3", "vcpus": 2, "swap": 0, "os-flavor-access:is_public": true, "name": "m1.medium", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:18:01.868693 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: INFO nova.api.openstack.requestlog [None req-5e74d79f-bba0-48ee-8469-2d14989356bc admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.767419 Aug 04 05:18:01.870719 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: [pid: 103950|app: 0|req: 15/28] 10.222.0.46 () {64 vars in 1283 bytes} [Thu Aug 4 05:18:01 2022] POST /compute/v2.1/flavors => generated 406 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 04 05:18:01.892354 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi [None req-d378f54e-47d5-4869-81b0-53ccf34309c5 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:18:01.898602 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG dbcounter [-] [103949] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=7,nova_api:SAVEPOINT=3,nova_api:RELEASE=3 {{(pid=103949) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:18:02.032079 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: INFO nova.api.openstack.requestlog [None req-d378f54e-47d5-4869-81b0-53ccf34309c5 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.145171 Aug 04 05:18:02.032895 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: [pid: 103949|app: 0|req: 14/29] 10.222.0.46 () {64 vars in 1333 bytes} [Thu Aug 4 05:18:01 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 05:18:04.813579 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi [None req-5e74d79f-bba0-48ee-8469-2d14989356bc admin admin] Calling method '>' {{(pid=103950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:18:04.816761 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: INFO nova.api.openstack.requestlog [None req-5e74d79f-bba0-48ee-8469-2d14989356bc admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002826 Aug 04 05:18:04.818022 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: [pid: 103950|app: 0|req: 16/30] 10.222.0.46 () {54 vars in 931 bytes} [Thu Aug 4 05:18:04 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:18:05.470768 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi [None req-bf51f4b6-d402-4af9-9309-fb151602f5cb admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "disk": 80, "id": "4", "swap": 0, "ram": 8192, "name": "m1.large", "vcpus": 4, "os-flavor-access:is_public": true, "rxtx_factor": 1.0}} {{(pid=103949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:18:05.559761 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: INFO nova.api.openstack.requestlog [None req-bf51f4b6-d402-4af9-9309-fb151602f5cb admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.734472 Aug 04 05:18:05.560521 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: [pid: 103949|app: 0|req: 15/31] 10.222.0.46 () {64 vars in 1283 bytes} [Thu Aug 4 05:18:04 2022] POST /compute/v2.1/flavors => generated 405 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 05:18:05.575636 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi [None req-a645691a-8776-403d-8103-bfde21454440 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:18:05.580925 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG dbcounter [-] [103950] Writing DB stats nova_api:SELECT=39,nova_api:SAVEPOINT=4,nova_api:INSERT=8,nova_api:RELEASE=4 {{(pid=103950) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:18:05.717061 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: INFO nova.api.openstack.requestlog [None req-a645691a-8776-403d-8103-bfde21454440 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.145273 Aug 04 05:18:05.717619 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: [pid: 103950|app: 0|req: 17/32] 10.222.0.46 () {64 vars in 1333 bytes} [Thu Aug 4 05:18:05 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:18:09.638203 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi [None req-bf51f4b6-d402-4af9-9309-fb151602f5cb admin admin] Calling method '>' {{(pid=103949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:18:09.639252 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: INFO nova.api.openstack.requestlog [None req-bf51f4b6-d402-4af9-9309-fb151602f5cb admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001504 Aug 04 05:18:09.640083 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: [pid: 103949|app: 0|req: 16/33] 10.222.0.46 () {54 vars in 931 bytes} [Thu Aug 4 05:18:09 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 05:18:10.406808 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi [None req-126e69a2-2677-4226-bfb2-586aac5f2bbf admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 8, "name": "m1.xlarge", "ram": 16384, "rxtx_factor": 1.0, "swap": 0, "os-flavor-access:is_public": true, "disk": 160, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "5"}} {{(pid=103950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:18:10.498513 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: INFO nova.api.openstack.requestlog [None req-126e69a2-2677-4226-bfb2-586aac5f2bbf admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.845385 Aug 04 05:18:10.508878 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: [pid: 103950|app: 0|req: 18/34] 10.222.0.46 () {64 vars in 1283 bytes} [Thu Aug 4 05:18:09 2022] POST /compute/v2.1/flavors => generated 408 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 04 05:18:10.516824 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi [None req-699beb10-07e6-4cb4-96a6-706057cd6e6e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:18:10.622166 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: INFO nova.api.openstack.requestlog [None req-699beb10-07e6-4cb4-96a6-706057cd6e6e admin admin] 10.222.0.46 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.110348 Aug 04 05:18:10.623526 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: [pid: 103949|app: 0|req: 17/35] 10.222.0.46 () {64 vars in 1333 bytes} [Thu Aug 4 05:18:10 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:18:31.116051 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi [None req-126e69a2-2677-4226-bfb2-586aac5f2bbf admin admin] Calling method '>' {{(pid=103950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:18:31.117233 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: INFO nova.api.openstack.requestlog [None req-126e69a2-2677-4226-bfb2-586aac5f2bbf admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001602 Aug 04 05:18:31.117792 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: [pid: 103950|app: 0|req: 19/36] 10.222.0.46 () {54 vars in 931 bytes} [Thu Aug 4 05:18:31 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:18:31.129378 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG dbcounter [-] [103949] Writing DB stats nova_api:SELECT=14,nova_api:SAVEPOINT=2,nova_api:INSERT=3,nova_api:RELEASE=2 {{(pid=103949) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:18:31.657537 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi [None req-7db70b94-e431-4ef8-8e12-9651ab666e55 admin admin] Calling method '>' {{(pid=103949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:18:31.677296 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: INFO nova.api.openstack.requestlog [None req-7db70b94-e431-4ef8-8e12-9651ab666e55 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.552465 Aug 04 05:18:31.677938 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: [pid: 103949|app: 0|req: 18/37] 10.222.0.46 () {60 vars in 1292 bytes} [Thu Aug 4 05:18:31 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 05:18:32.844933 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi [None req-126e69a2-2677-4226-bfb2-586aac5f2bbf admin admin] Calling method '>' {{(pid=103950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:18:32.846031 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: INFO nova.api.openstack.requestlog [None req-126e69a2-2677-4226-bfb2-586aac5f2bbf admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001512 Aug 04 05:18:32.846493 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: [pid: 103950|app: 0|req: 20/38] 10.222.0.46 () {56 vars in 1074 bytes} [Thu Aug 4 05:18:32 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:18:33.476680 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi [None req-8810234a-4a3e-448f-a427-339312d82cf1 admin admin] Calling method '>' {{(pid=103949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:18:33.482708 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: INFO nova.api.openstack.wsgi [None req-8810234a-4a3e-448f-a427-339312d82cf1 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 04 05:18:33.486141 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi [None req-8810234a-4a3e-448f-a427-339312d82cf1 admin admin] Request method failure captured: Aug 04 05:18:33.486141 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 04 05:18:33.486141 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: Accept: application/json Aug 04 05:18:33.486141 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: Accept-Encoding: gzip, deflate Aug 04 05:18:33.486141 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: Connection: keep-alive Aug 04 05:18:33.486141 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: Content-Length: 0 Aug 04 05:18:33.486141 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: Host: 10.222.0.46 Aug 04 05:18:33.486141 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: Openstack-Api-Version: compute 2.90 Aug 04 05:18:33.486141 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: Openstack-System-Scope: None Aug 04 05:18:33.486141 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: User-Agent: python-novaclient Aug 04 05:18:33.486141 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: X-Auth-Token: gAAAAABi61aoNbtZCHc9dVMMSdCW_KI-jdzTaliz1jBHj9uIl-hGJMxKSTPpGkRsh0qkwO_pFLCWacKWc8NTi4ML2e8BnrMqGhHdBSc_pVXwnSoU1cDnzgAwzuumf2cf2hxxcjNgm3RKmgaY1azkDkA2AxycRs-INi1H6t67k4Jq4knE0A5TQuw Aug 04 05:18:33.486141 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: X-Domain-Id: None Aug 04 05:18:33.486141 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: X-Domain-Name: None Aug 04 05:18:33.486141 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: X-Identity-Status: Confirmed Aug 04 05:18:33.486141 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: X-Is-Admin-Project: True Aug 04 05:18:33.486141 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: X-Openstack-Nova-Api-Version: 2.90 Aug 04 05:18:33.486141 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: X-Project-Domain-Id: default Aug 04 05:18:33.486141 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: X-Project-Domain-Name: Default Aug 04 05:18:33.486141 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: X-Project-Id: d0fa97262e904ea29696d2d9cb8b9bc3 Aug 04 05:18:33.486141 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: X-Project-Name: admin Aug 04 05:18:33.486141 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: X-Role: member,admin,reader Aug 04 05:18:33.486141 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: X-Roles: member,admin,reader Aug 04 05:18:33.488969 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/d0fa97262e904ea29696d2d9cb8b9bc3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/d0fa97262e904ea29696d2d9cb8b9bc3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_d0fa97262e904ea29696d2d9cb8b9bc3", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/d0fa97262e904ea29696d2d9cb8b9bc3"}]}] Aug 04 05:18:33.488969 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: X-Tenant: admin Aug 04 05:18:33.488969 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: X-Tenant-Id: d0fa97262e904ea29696d2d9cb8b9bc3 Aug 04 05:18:33.488969 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: X-Tenant-Name: admin Aug 04 05:18:33.488969 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: X-User: admin Aug 04 05:18:33.488969 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: X-User-Domain-Id: default Aug 04 05:18:33.488969 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: X-User-Domain-Name: Default Aug 04 05:18:33.488969 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: X-User-Id: 75b3532d53944d4789f9bd6bd6ab00cf Aug 04 05:18:33.488969 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: X-User-Name: admin Aug 04 05:18:33.488969 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: method: > Aug 04 05:18:33.488969 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: exception: Flavor 42 could not be found. Aug 04 05:18:33.488969 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: action_args: {'id': '42'} Aug 04 05:18:33.488969 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: {{(pid=103949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 05:18:33.488969 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:18:33.490943 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 04 05:18:33.490943 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 04 05:18:33.490943 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 04 05:18:33.490943 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 04 05:18:33.490943 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 04 05:18:33.490943 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 04 05:18:33.490943 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 04 05:18:33.490943 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 04 05:18:33.490943 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 04 05:18:33.490943 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 05:18:33.490943 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 04 05:18:33.490943 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 04 05:18:33.490943 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 04 05:18:33.490943 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: ERROR nova.api.openstack.wsgi Aug 04 05:18:33.490943 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:18:33.490943 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: ERROR nova.api.openstack.wsgi Aug 04 05:18:33.490943 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:18:33.490943 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:18:33.490943 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:18:33.493679 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 05:18:33.493679 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 05:18:33.493679 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 05:18:33.493679 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 05:18:33.493679 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 04 05:18:33.493679 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 04 05:18:33.493679 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 04 05:18:33.493679 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: ERROR nova.api.openstack.wsgi Aug 04 05:18:33.493679 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:18:33.493679 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: ERROR nova.api.openstack.wsgi Aug 04 05:18:33.493679 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:18:33.493679 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:18:33.493679 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:18:33.493679 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 05:18:33.493679 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 05:18:33.493679 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 04 05:18:33.493679 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: ERROR nova.api.openstack.wsgi Aug 04 05:18:33.493679 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi [None req-8810234a-4a3e-448f-a427-339312d82cf1 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103949) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 05:18:33.496250 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: INFO nova.api.openstack.requestlog [None req-8810234a-4a3e-448f-a427-339312d82cf1 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.499036 Aug 04 05:18:33.496250 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: [pid: 103949|app: 0|req: 19/39] 10.222.0.46 () {60 vars in 1190 bytes} [Thu Aug 4 05:18:32 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 500 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 04 05:18:33.504401 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi [None req-5b30d6db-a47d-4a67-a03f-ab515b2071b2 admin admin] Calling method '>' {{(pid=103950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:18:33.508649 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG dbcounter [-] [103950] Writing DB stats nova_api:SELECT=8,nova_api:SAVEPOINT=1,nova_api:INSERT=2,nova_api:RELEASE=1 {{(pid=103950) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:18:33.530718 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: INFO nova.api.openstack.requestlog [None req-5b30d6db-a47d-4a67-a03f-ab515b2071b2 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.031256 Aug 04 05:18:33.531306 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: [pid: 103950|app: 0|req: 21/40] 10.222.0.46 () {60 vars in 1210 bytes} [Thu Aug 4 05:18:33 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 05:18:33.546033 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi [None req-876c2498-5bff-44ef-bc79-bb5844875470 admin admin] Calling method '>' {{(pid=103949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:18:33.572375 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: INFO nova.api.openstack.requestlog [None req-876c2498-5bff-44ef-bc79-bb5844875470 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.032398 Aug 04 05:18:33.572948 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: [pid: 103949|app: 0|req: 20/41] 10.222.0.46 () {60 vars in 1210 bytes} [Thu Aug 4 05:18:33 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 05:18:33.582853 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi [None req-90e95c05-271c-4693-88a1-efdc6f63dfaf admin admin] Calling method '>' {{(pid=103950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:18:33.589214 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: INFO nova.api.openstack.wsgi [None req-90e95c05-271c-4693-88a1-efdc6f63dfaf admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 04 05:18:33.592554 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi [None req-90e95c05-271c-4693-88a1-efdc6f63dfaf admin admin] Request method failure captured: Aug 04 05:18:33.592554 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 04 05:18:33.592554 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: Accept: application/json Aug 04 05:18:33.592554 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: Accept-Encoding: gzip, deflate Aug 04 05:18:33.592554 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: Connection: keep-alive Aug 04 05:18:33.592554 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: Content-Length: 0 Aug 04 05:18:33.592554 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: Host: 10.222.0.46 Aug 04 05:18:33.592554 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: Openstack-Api-Version: compute 2.90 Aug 04 05:18:33.592554 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: Openstack-System-Scope: None Aug 04 05:18:33.592554 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: User-Agent: python-novaclient Aug 04 05:18:33.592554 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: X-Auth-Token: gAAAAABi61aoNbtZCHc9dVMMSdCW_KI-jdzTaliz1jBHj9uIl-hGJMxKSTPpGkRsh0qkwO_pFLCWacKWc8NTi4ML2e8BnrMqGhHdBSc_pVXwnSoU1cDnzgAwzuumf2cf2hxxcjNgm3RKmgaY1azkDkA2AxycRs-INi1H6t67k4Jq4knE0A5TQuw Aug 04 05:18:33.592554 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: X-Domain-Id: None Aug 04 05:18:33.592554 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: X-Domain-Name: None Aug 04 05:18:33.592554 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: X-Identity-Status: Confirmed Aug 04 05:18:33.592554 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: X-Is-Admin-Project: True Aug 04 05:18:33.592554 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: X-Openstack-Nova-Api-Version: 2.90 Aug 04 05:18:33.592554 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: X-Project-Domain-Id: default Aug 04 05:18:33.592554 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: X-Project-Domain-Name: Default Aug 04 05:18:33.592554 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: X-Project-Id: d0fa97262e904ea29696d2d9cb8b9bc3 Aug 04 05:18:33.592554 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: X-Project-Name: admin Aug 04 05:18:33.592554 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: X-Role: member,admin,reader Aug 04 05:18:33.592554 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: X-Roles: member,admin,reader Aug 04 05:18:33.598535 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/d0fa97262e904ea29696d2d9cb8b9bc3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/d0fa97262e904ea29696d2d9cb8b9bc3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_d0fa97262e904ea29696d2d9cb8b9bc3", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/d0fa97262e904ea29696d2d9cb8b9bc3"}]}] Aug 04 05:18:33.598535 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: X-Tenant: admin Aug 04 05:18:33.598535 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: X-Tenant-Id: d0fa97262e904ea29696d2d9cb8b9bc3 Aug 04 05:18:33.598535 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: X-Tenant-Name: admin Aug 04 05:18:33.598535 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: X-User: admin Aug 04 05:18:33.598535 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: X-User-Domain-Id: default Aug 04 05:18:33.598535 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: X-User-Domain-Name: Default Aug 04 05:18:33.598535 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: X-User-Id: 75b3532d53944d4789f9bd6bd6ab00cf Aug 04 05:18:33.598535 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: X-User-Name: admin Aug 04 05:18:33.598535 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: method: > Aug 04 05:18:33.598535 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: exception: Flavor 42 could not be found. Aug 04 05:18:33.598535 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: action_args: {'id': '42'} Aug 04 05:18:33.598535 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: {{(pid=103950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 05:18:33.598535 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:18:33.599654 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 04 05:18:33.599654 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 04 05:18:33.599654 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 04 05:18:33.599654 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 04 05:18:33.599654 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 04 05:18:33.599654 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 04 05:18:33.599654 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 04 05:18:33.599654 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 04 05:18:33.599654 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 04 05:18:33.599654 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 05:18:33.599654 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 04 05:18:33.599654 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 04 05:18:33.599654 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 04 05:18:33.599654 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: ERROR nova.api.openstack.wsgi Aug 04 05:18:33.599654 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:18:33.599654 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: ERROR nova.api.openstack.wsgi Aug 04 05:18:33.599654 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:18:33.599654 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:18:33.599654 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:18:33.601516 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 05:18:33.601516 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 05:18:33.601516 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 05:18:33.601516 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 05:18:33.601516 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 04 05:18:33.601516 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 04 05:18:33.601516 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 04 05:18:33.601516 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: ERROR nova.api.openstack.wsgi Aug 04 05:18:33.601516 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:18:33.601516 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: ERROR nova.api.openstack.wsgi Aug 04 05:18:33.601516 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:18:33.601516 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:18:33.601516 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:18:33.601516 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 05:18:33.601516 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 05:18:33.601516 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 04 05:18:33.601516 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: ERROR nova.api.openstack.wsgi Aug 04 05:18:33.601516 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi [None req-90e95c05-271c-4693-88a1-efdc6f63dfaf admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103950) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 05:18:33.603384 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: INFO nova.api.openstack.requestlog [None req-90e95c05-271c-4693-88a1-efdc6f63dfaf admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.014925 Aug 04 05:18:33.603384 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: [pid: 103950|app: 0|req: 22/42] 10.222.0.46 () {60 vars in 1190 bytes} [Thu Aug 4 05:18:33 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 04 05:18:34.629930 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi [None req-876c2498-5bff-44ef-bc79-bb5844875470 admin admin] Calling method '>' {{(pid=103949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:18:34.630979 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: INFO nova.api.openstack.requestlog [None req-876c2498-5bff-44ef-bc79-bb5844875470 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001496 Aug 04 05:18:34.631382 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: [pid: 103949|app: 0|req: 21/43] 10.222.0.46 () {56 vars in 1074 bytes} [Thu Aug 4 05:18:34 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:18:35.239774 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi [None req-3a2f8c2b-3ae7-4a0d-abe4-05b199d1a081 admin admin] Calling method '>' {{(pid=103950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:18:35.248219 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: INFO nova.api.openstack.wsgi [None req-3a2f8c2b-3ae7-4a0d-abe4-05b199d1a081 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 04 05:18:35.249794 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi [None req-3a2f8c2b-3ae7-4a0d-abe4-05b199d1a081 admin admin] Request method failure captured: Aug 04 05:18:35.249794 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 04 05:18:35.249794 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: Accept: application/json Aug 04 05:18:35.249794 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: Accept-Encoding: gzip, deflate Aug 04 05:18:35.249794 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: Connection: keep-alive Aug 04 05:18:35.249794 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: Content-Length: 0 Aug 04 05:18:35.249794 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: Host: 10.222.0.46 Aug 04 05:18:35.249794 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: Openstack-Api-Version: compute 2.90 Aug 04 05:18:35.249794 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: Openstack-System-Scope: None Aug 04 05:18:35.249794 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: User-Agent: python-novaclient Aug 04 05:18:35.249794 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: X-Auth-Token: gAAAAABi61aqe58Lgcedz8n98O8HxJ2ZjnBO6C727tyR9zXwE8xCrQDDqivdeKU0p-DtvrqQm5HeJtbzxW45v3PexB1RGLtWmljfEGhleHDCjsUCZZwJ8mhE1Ir3-TyWfA-btr8FiSut1hlG21FSqcSGCek01UXI0MD7sDDaeLEc1O37UQTC4I0 Aug 04 05:18:35.249794 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: X-Domain-Id: None Aug 04 05:18:35.249794 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: X-Domain-Name: None Aug 04 05:18:35.249794 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: X-Identity-Status: Confirmed Aug 04 05:18:35.249794 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: X-Is-Admin-Project: True Aug 04 05:18:35.249794 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: X-Openstack-Nova-Api-Version: 2.90 Aug 04 05:18:35.249794 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: X-Project-Domain-Id: default Aug 04 05:18:35.249794 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: X-Project-Domain-Name: Default Aug 04 05:18:35.249794 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: X-Project-Id: d0fa97262e904ea29696d2d9cb8b9bc3 Aug 04 05:18:35.249794 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: X-Project-Name: admin Aug 04 05:18:35.249794 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: X-Role: member,admin,reader Aug 04 05:18:35.249794 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: X-Roles: member,admin,reader Aug 04 05:18:35.252342 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/d0fa97262e904ea29696d2d9cb8b9bc3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/d0fa97262e904ea29696d2d9cb8b9bc3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_d0fa97262e904ea29696d2d9cb8b9bc3", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/d0fa97262e904ea29696d2d9cb8b9bc3"}]}] Aug 04 05:18:35.252342 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: X-Tenant: admin Aug 04 05:18:35.252342 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: X-Tenant-Id: d0fa97262e904ea29696d2d9cb8b9bc3 Aug 04 05:18:35.252342 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: X-Tenant-Name: admin Aug 04 05:18:35.252342 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: X-User: admin Aug 04 05:18:35.252342 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: X-User-Domain-Id: default Aug 04 05:18:35.252342 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: X-User-Domain-Name: Default Aug 04 05:18:35.252342 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: X-User-Id: 75b3532d53944d4789f9bd6bd6ab00cf Aug 04 05:18:35.252342 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: X-User-Name: admin Aug 04 05:18:35.252342 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: method: > Aug 04 05:18:35.252342 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: exception: Flavor 84 could not be found. Aug 04 05:18:35.252342 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: action_args: {'id': '84'} Aug 04 05:18:35.252342 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: {{(pid=103950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 05:18:35.252342 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:18:35.254061 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 04 05:18:35.254061 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 04 05:18:35.254061 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 04 05:18:35.254061 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 04 05:18:35.254061 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 04 05:18:35.254061 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 04 05:18:35.254061 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 04 05:18:35.254061 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 04 05:18:35.254061 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 04 05:18:35.254061 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 05:18:35.254061 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 04 05:18:35.254061 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 04 05:18:35.254061 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 04 05:18:35.254061 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: ERROR nova.api.openstack.wsgi Aug 04 05:18:35.254061 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:18:35.254061 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: ERROR nova.api.openstack.wsgi Aug 04 05:18:35.254061 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:18:35.254061 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:18:35.254061 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:18:35.256509 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 05:18:35.256509 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 05:18:35.256509 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 05:18:35.256509 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 05:18:35.256509 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 04 05:18:35.256509 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 04 05:18:35.256509 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 04 05:18:35.256509 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: ERROR nova.api.openstack.wsgi Aug 04 05:18:35.256509 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:18:35.256509 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: ERROR nova.api.openstack.wsgi Aug 04 05:18:35.256509 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:18:35.256509 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:18:35.256509 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:18:35.256509 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 05:18:35.256509 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 05:18:35.256509 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 04 05:18:35.256509 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: ERROR nova.api.openstack.wsgi Aug 04 05:18:35.256509 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi [None req-3a2f8c2b-3ae7-4a0d-abe4-05b199d1a081 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103950) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 05:18:35.258817 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: INFO nova.api.openstack.requestlog [None req-3a2f8c2b-3ae7-4a0d-abe4-05b199d1a081 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.477140 Aug 04 05:18:35.258817 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: [pid: 103950|app: 0|req: 23/44] 10.222.0.46 () {60 vars in 1190 bytes} [Thu Aug 4 05:18:34 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 478 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 04 05:18:35.264424 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi [None req-08e0c9f4-48b0-4eed-a40a-0868c9bef5dd admin admin] Calling method '>' {{(pid=103949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:18:35.280132 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: INFO nova.api.openstack.requestlog [None req-08e0c9f4-48b0-4eed-a40a-0868c9bef5dd admin admin] 10.222.0.46 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019289 Aug 04 05:18:35.280690 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: [pid: 103949|app: 0|req: 22/45] 10.222.0.46 () {60 vars in 1210 bytes} [Thu Aug 4 05:18:35 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 05:18:35.299025 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi [None req-ba3913fd-bde9-4b58-845d-f15f6ee19087 admin admin] Calling method '>' {{(pid=103950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:18:35.327881 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: INFO nova.api.openstack.requestlog [None req-ba3913fd-bde9-4b58-845d-f15f6ee19087 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.035207 Aug 04 05:18:35.328899 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: [pid: 103950|app: 0|req: 24/46] 10.222.0.46 () {60 vars in 1210 bytes} [Thu Aug 4 05:18:35 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 05:18:35.341529 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi [None req-31a4951c-0977-4453-bef1-1f742932d6f7 admin admin] Calling method '>' {{(pid=103949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:18:35.347981 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: INFO nova.api.openstack.wsgi [None req-31a4951c-0977-4453-bef1-1f742932d6f7 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 04 05:18:35.349464 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi [None req-31a4951c-0977-4453-bef1-1f742932d6f7 admin admin] Request method failure captured: Aug 04 05:18:35.349464 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 04 05:18:35.349464 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: Accept: application/json Aug 04 05:18:35.349464 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: Accept-Encoding: gzip, deflate Aug 04 05:18:35.349464 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: Connection: keep-alive Aug 04 05:18:35.349464 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: Content-Length: 0 Aug 04 05:18:35.349464 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: Host: 10.222.0.46 Aug 04 05:18:35.349464 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: Openstack-Api-Version: compute 2.90 Aug 04 05:18:35.349464 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: Openstack-System-Scope: None Aug 04 05:18:35.349464 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: User-Agent: python-novaclient Aug 04 05:18:35.349464 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: X-Auth-Token: gAAAAABi61aqe58Lgcedz8n98O8HxJ2ZjnBO6C727tyR9zXwE8xCrQDDqivdeKU0p-DtvrqQm5HeJtbzxW45v3PexB1RGLtWmljfEGhleHDCjsUCZZwJ8mhE1Ir3-TyWfA-btr8FiSut1hlG21FSqcSGCek01UXI0MD7sDDaeLEc1O37UQTC4I0 Aug 04 05:18:35.349464 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: X-Domain-Id: None Aug 04 05:18:35.349464 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: X-Domain-Name: None Aug 04 05:18:35.349464 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: X-Identity-Status: Confirmed Aug 04 05:18:35.349464 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: X-Is-Admin-Project: True Aug 04 05:18:35.349464 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: X-Openstack-Nova-Api-Version: 2.90 Aug 04 05:18:35.349464 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: X-Project-Domain-Id: default Aug 04 05:18:35.349464 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: X-Project-Domain-Name: Default Aug 04 05:18:35.349464 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: X-Project-Id: d0fa97262e904ea29696d2d9cb8b9bc3 Aug 04 05:18:35.349464 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: X-Project-Name: admin Aug 04 05:18:35.349464 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: X-Role: member,admin,reader Aug 04 05:18:35.349464 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: X-Roles: member,admin,reader Aug 04 05:18:35.352193 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/d0fa97262e904ea29696d2d9cb8b9bc3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/d0fa97262e904ea29696d2d9cb8b9bc3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_d0fa97262e904ea29696d2d9cb8b9bc3", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/d0fa97262e904ea29696d2d9cb8b9bc3"}]}] Aug 04 05:18:35.352193 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: X-Tenant: admin Aug 04 05:18:35.352193 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: X-Tenant-Id: d0fa97262e904ea29696d2d9cb8b9bc3 Aug 04 05:18:35.352193 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: X-Tenant-Name: admin Aug 04 05:18:35.352193 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: X-User: admin Aug 04 05:18:35.352193 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: X-User-Domain-Id: default Aug 04 05:18:35.352193 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: X-User-Domain-Name: Default Aug 04 05:18:35.352193 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: X-User-Id: 75b3532d53944d4789f9bd6bd6ab00cf Aug 04 05:18:35.352193 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: X-User-Name: admin Aug 04 05:18:35.352193 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: method: > Aug 04 05:18:35.352193 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: exception: Flavor 84 could not be found. Aug 04 05:18:35.352193 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: action_args: {'id': '84'} Aug 04 05:18:35.352193 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: {{(pid=103949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 05:18:35.352193 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:18:35.354182 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 04 05:18:35.354182 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 04 05:18:35.354182 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 04 05:18:35.354182 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 04 05:18:35.354182 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 04 05:18:35.354182 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 04 05:18:35.354182 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 04 05:18:35.354182 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 04 05:18:35.354182 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 04 05:18:35.354182 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 05:18:35.354182 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 04 05:18:35.354182 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 04 05:18:35.354182 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 04 05:18:35.354182 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: ERROR nova.api.openstack.wsgi Aug 04 05:18:35.354182 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:18:35.354182 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: ERROR nova.api.openstack.wsgi Aug 04 05:18:35.354182 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:18:35.354182 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:18:35.354182 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:18:35.356625 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 05:18:35.356625 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 05:18:35.356625 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 05:18:35.356625 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 05:18:35.356625 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 04 05:18:35.356625 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 04 05:18:35.356625 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 04 05:18:35.356625 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: ERROR nova.api.openstack.wsgi Aug 04 05:18:35.356625 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:18:35.356625 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: ERROR nova.api.openstack.wsgi Aug 04 05:18:35.356625 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:18:35.356625 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:18:35.356625 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:18:35.356625 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 05:18:35.356625 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 05:18:35.356625 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 04 05:18:35.356625 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: ERROR nova.api.openstack.wsgi Aug 04 05:18:35.356625 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi [None req-31a4951c-0977-4453-bef1-1f742932d6f7 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103949) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 05:18:35.358913 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: INFO nova.api.openstack.requestlog [None req-31a4951c-0977-4453-bef1-1f742932d6f7 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.013045 Aug 04 05:18:35.358913 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: [pid: 103949|app: 0|req: 23/47] 10.222.0.46 () {60 vars in 1190 bytes} [Thu Aug 4 05:18:35 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 04 05:18:36.394965 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi [None req-ba3913fd-bde9-4b58-845d-f15f6ee19087 admin admin] Calling method '>' {{(pid=103950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:18:36.395981 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: INFO nova.api.openstack.requestlog [None req-ba3913fd-bde9-4b58-845d-f15f6ee19087 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001527 Aug 04 05:18:36.396372 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: [pid: 103950|app: 0|req: 25/48] 10.222.0.46 () {56 vars in 1074 bytes} [Thu Aug 4 05:18:36 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:18:37.001596 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi [None req-ee10447a-2ab3-411b-b76b-ff2ab3ddf3fb admin admin] Calling method '>' {{(pid=103949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:18:37.008903 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: INFO nova.api.openstack.wsgi [None req-ee10447a-2ab3-411b-b76b-ff2ab3ddf3fb admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 04 05:18:37.010665 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi [None req-ee10447a-2ab3-411b-b76b-ff2ab3ddf3fb admin admin] Request method failure captured: Aug 04 05:18:37.010665 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 04 05:18:37.010665 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: Accept: application/json Aug 04 05:18:37.010665 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: Accept-Encoding: gzip, deflate Aug 04 05:18:37.010665 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: Connection: keep-alive Aug 04 05:18:37.010665 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: Content-Length: 0 Aug 04 05:18:37.010665 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: Host: 10.222.0.46 Aug 04 05:18:37.010665 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: Openstack-Api-Version: compute 2.90 Aug 04 05:18:37.010665 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: Openstack-System-Scope: None Aug 04 05:18:37.010665 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: User-Agent: python-novaclient Aug 04 05:18:37.010665 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: X-Auth-Token: gAAAAABi61asR7zO6PQrKgm6ILfLLFj1mIIY5V0id70ddmcNsjXM5CDr5Xv_GalN0V86K5bHbe73Q1BHkLc5pE6eXLclZnjDeMmbZPihwix3X6f1eIfOwW69cqAzA96cmvYx9QCD3J1OnC_01Os-Q9XNv6gWEJ92XJGJPjgM03LpIOLEiPJHF0k Aug 04 05:18:37.010665 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: X-Domain-Id: None Aug 04 05:18:37.010665 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: X-Domain-Name: None Aug 04 05:18:37.010665 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: X-Identity-Status: Confirmed Aug 04 05:18:37.010665 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: X-Is-Admin-Project: True Aug 04 05:18:37.010665 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: X-Openstack-Nova-Api-Version: 2.90 Aug 04 05:18:37.010665 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: X-Project-Domain-Id: default Aug 04 05:18:37.010665 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: X-Project-Domain-Name: Default Aug 04 05:18:37.010665 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: X-Project-Id: d0fa97262e904ea29696d2d9cb8b9bc3 Aug 04 05:18:37.010665 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: X-Project-Name: admin Aug 04 05:18:37.010665 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: X-Role: member,admin,reader Aug 04 05:18:37.010665 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: X-Roles: member,admin,reader Aug 04 05:18:37.013024 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/d0fa97262e904ea29696d2d9cb8b9bc3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/d0fa97262e904ea29696d2d9cb8b9bc3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_d0fa97262e904ea29696d2d9cb8b9bc3", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/d0fa97262e904ea29696d2d9cb8b9bc3"}]}] Aug 04 05:18:37.013024 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: X-Tenant: admin Aug 04 05:18:37.013024 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: X-Tenant-Id: d0fa97262e904ea29696d2d9cb8b9bc3 Aug 04 05:18:37.013024 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: X-Tenant-Name: admin Aug 04 05:18:37.013024 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: X-User: admin Aug 04 05:18:37.013024 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: X-User-Domain-Id: default Aug 04 05:18:37.013024 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: X-User-Domain-Name: Default Aug 04 05:18:37.013024 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: X-User-Id: 75b3532d53944d4789f9bd6bd6ab00cf Aug 04 05:18:37.013024 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: X-User-Name: admin Aug 04 05:18:37.013024 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: method: > Aug 04 05:18:37.013024 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: exception: Flavor 451 could not be found. Aug 04 05:18:37.013024 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: action_args: {'id': '451'} Aug 04 05:18:37.013024 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: {{(pid=103949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 05:18:37.013024 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:18:37.014545 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 04 05:18:37.014545 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 04 05:18:37.014545 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 04 05:18:37.014545 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 04 05:18:37.014545 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 04 05:18:37.014545 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 04 05:18:37.014545 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 04 05:18:37.014545 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 04 05:18:37.014545 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 04 05:18:37.014545 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 05:18:37.014545 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 04 05:18:37.014545 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 04 05:18:37.014545 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 04 05:18:37.014545 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: ERROR nova.api.openstack.wsgi Aug 04 05:18:37.014545 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:18:37.014545 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: ERROR nova.api.openstack.wsgi Aug 04 05:18:37.014545 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:18:37.014545 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:18:37.014545 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:18:37.016553 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 05:18:37.016553 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 05:18:37.016553 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 05:18:37.016553 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 05:18:37.016553 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 04 05:18:37.016553 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 04 05:18:37.016553 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 04 05:18:37.016553 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: ERROR nova.api.openstack.wsgi Aug 04 05:18:37.016553 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:18:37.016553 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: ERROR nova.api.openstack.wsgi Aug 04 05:18:37.016553 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:18:37.016553 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:18:37.016553 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:18:37.016553 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 05:18:37.016553 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 05:18:37.016553 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 04 05:18:37.016553 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: ERROR nova.api.openstack.wsgi Aug 04 05:18:37.016553 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi [None req-ee10447a-2ab3-411b-b76b-ff2ab3ddf3fb admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103949) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 05:18:37.021454 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: INFO nova.api.openstack.requestlog [None req-ee10447a-2ab3-411b-b76b-ff2ab3ddf3fb admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.473373 Aug 04 05:18:37.021454 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: [pid: 103949|app: 0|req: 24/49] 10.222.0.46 () {60 vars in 1193 bytes} [Thu Aug 4 05:18:36 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 475 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 04 05:18:37.025844 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi [None req-4cb77330-bb64-4a7b-af4c-84f07fc39026 admin admin] Calling method '>' {{(pid=103950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:18:37.044567 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: INFO nova.api.openstack.requestlog [None req-4cb77330-bb64-4a7b-af4c-84f07fc39026 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.022624 Aug 04 05:18:37.045150 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: [pid: 103950|app: 0|req: 26/50] 10.222.0.46 () {60 vars in 1210 bytes} [Thu Aug 4 05:18:37 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 05:18:37.059864 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi [None req-10cd9ba7-9ed9-4142-a7bb-3c7df21e969c admin admin] Calling method '>' {{(pid=103949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:18:37.076865 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: INFO nova.api.openstack.requestlog [None req-10cd9ba7-9ed9-4142-a7bb-3c7df21e969c admin admin] 10.222.0.46 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.020631 Aug 04 05:18:37.077450 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: [pid: 103949|app: 0|req: 25/51] 10.222.0.46 () {60 vars in 1210 bytes} [Thu Aug 4 05:18:37 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 05:18:37.087472 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi [None req-0e324f84-cdf8-4e4e-87ea-59437938e616 admin admin] Calling method '>' {{(pid=103950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:18:37.093631 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: INFO nova.api.openstack.wsgi [None req-0e324f84-cdf8-4e4e-87ea-59437938e616 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 04 05:18:37.095229 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi [None req-0e324f84-cdf8-4e4e-87ea-59437938e616 admin admin] Request method failure captured: Aug 04 05:18:37.095229 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 04 05:18:37.095229 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: Accept: application/json Aug 04 05:18:37.095229 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: Accept-Encoding: gzip, deflate Aug 04 05:18:37.095229 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: Connection: keep-alive Aug 04 05:18:37.095229 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: Content-Length: 0 Aug 04 05:18:37.095229 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: Host: 10.222.0.46 Aug 04 05:18:37.095229 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: Openstack-Api-Version: compute 2.90 Aug 04 05:18:37.095229 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: Openstack-System-Scope: None Aug 04 05:18:37.095229 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: User-Agent: python-novaclient Aug 04 05:18:37.095229 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: X-Auth-Token: gAAAAABi61asR7zO6PQrKgm6ILfLLFj1mIIY5V0id70ddmcNsjXM5CDr5Xv_GalN0V86K5bHbe73Q1BHkLc5pE6eXLclZnjDeMmbZPihwix3X6f1eIfOwW69cqAzA96cmvYx9QCD3J1OnC_01Os-Q9XNv6gWEJ92XJGJPjgM03LpIOLEiPJHF0k Aug 04 05:18:37.095229 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: X-Domain-Id: None Aug 04 05:18:37.095229 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: X-Domain-Name: None Aug 04 05:18:37.095229 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: X-Identity-Status: Confirmed Aug 04 05:18:37.095229 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: X-Is-Admin-Project: True Aug 04 05:18:37.095229 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: X-Openstack-Nova-Api-Version: 2.90 Aug 04 05:18:37.095229 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: X-Project-Domain-Id: default Aug 04 05:18:37.095229 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: X-Project-Domain-Name: Default Aug 04 05:18:37.095229 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: X-Project-Id: d0fa97262e904ea29696d2d9cb8b9bc3 Aug 04 05:18:37.095229 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: X-Project-Name: admin Aug 04 05:18:37.095229 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: X-Role: member,admin,reader Aug 04 05:18:37.095229 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: X-Roles: member,admin,reader Aug 04 05:18:37.097540 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/d0fa97262e904ea29696d2d9cb8b9bc3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/d0fa97262e904ea29696d2d9cb8b9bc3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_d0fa97262e904ea29696d2d9cb8b9bc3", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/d0fa97262e904ea29696d2d9cb8b9bc3"}]}] Aug 04 05:18:37.097540 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: X-Tenant: admin Aug 04 05:18:37.097540 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: X-Tenant-Id: d0fa97262e904ea29696d2d9cb8b9bc3 Aug 04 05:18:37.097540 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: X-Tenant-Name: admin Aug 04 05:18:37.097540 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: X-User: admin Aug 04 05:18:37.097540 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: X-User-Domain-Id: default Aug 04 05:18:37.097540 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: X-User-Domain-Name: Default Aug 04 05:18:37.097540 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: X-User-Id: 75b3532d53944d4789f9bd6bd6ab00cf Aug 04 05:18:37.097540 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: X-User-Name: admin Aug 04 05:18:37.097540 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: method: > Aug 04 05:18:37.097540 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: exception: Flavor 451 could not be found. Aug 04 05:18:37.097540 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: action_args: {'id': '451'} Aug 04 05:18:37.097540 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: {{(pid=103950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 05:18:37.097540 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:18:37.099215 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 04 05:18:37.099215 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 04 05:18:37.099215 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 04 05:18:37.099215 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 04 05:18:37.099215 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 04 05:18:37.099215 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 04 05:18:37.099215 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 04 05:18:37.099215 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 04 05:18:37.099215 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 04 05:18:37.099215 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 05:18:37.099215 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 04 05:18:37.099215 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 04 05:18:37.099215 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 04 05:18:37.099215 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: ERROR nova.api.openstack.wsgi Aug 04 05:18:37.099215 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:18:37.099215 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: ERROR nova.api.openstack.wsgi Aug 04 05:18:37.099215 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:18:37.099215 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:18:37.099215 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:18:37.100695 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 05:18:37.100695 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 05:18:37.100695 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 05:18:37.100695 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 05:18:37.100695 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 04 05:18:37.100695 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 04 05:18:37.100695 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 04 05:18:37.100695 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: ERROR nova.api.openstack.wsgi Aug 04 05:18:37.100695 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:18:37.100695 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: ERROR nova.api.openstack.wsgi Aug 04 05:18:37.100695 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:18:37.100695 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:18:37.100695 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:18:37.100695 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 05:18:37.100695 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 05:18:37.100695 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 04 05:18:37.100695 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: ERROR nova.api.openstack.wsgi Aug 04 05:18:37.100695 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi [None req-0e324f84-cdf8-4e4e-87ea-59437938e616 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103950) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 05:18:37.102929 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: INFO nova.api.openstack.requestlog [None req-0e324f84-cdf8-4e4e-87ea-59437938e616 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012918 Aug 04 05:18:37.102929 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: [pid: 103950|app: 0|req: 27/52] 10.222.0.46 () {60 vars in 1193 bytes} [Thu Aug 4 05:18:37 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 04 05:18:38.150219 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi [None req-10cd9ba7-9ed9-4142-a7bb-3c7df21e969c admin admin] Calling method '>' {{(pid=103949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:18:38.151268 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: INFO nova.api.openstack.requestlog [None req-10cd9ba7-9ed9-4142-a7bb-3c7df21e969c admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001797 Aug 04 05:18:38.151671 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: [pid: 103949|app: 0|req: 26/53] 10.222.0.46 () {56 vars in 1074 bytes} [Thu Aug 4 05:18:38 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:18:38.748678 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi [None req-7eac49f7-aa99-4863-90f8-e83651bd7c16 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:18:38.839396 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: INFO nova.api.openstack.requestlog [None req-7eac49f7-aa99-4863-90f8-e83651bd7c16 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.545676 Aug 04 05:18:38.840061 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: [pid: 103950|app: 0|req: 28/54] 10.222.0.46 () {64 vars in 1235 bytes} [Thu Aug 4 05:18:38 2022] POST /compute/v2.1/flavors => generated 404 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 05:18:39.936915 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi [None req-10cd9ba7-9ed9-4142-a7bb-3c7df21e969c admin admin] Calling method '>' {{(pid=103949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:18:39.937927 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: INFO nova.api.openstack.requestlog [None req-10cd9ba7-9ed9-4142-a7bb-3c7df21e969c admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001462 Aug 04 05:18:39.939854 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: [pid: 103949|app: 0|req: 27/55] 10.222.0.46 () {56 vars in 1074 bytes} [Thu Aug 4 05:18:39 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:18:40.548725 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi [None req-741da5fe-78f4-4269-81db-3d9aa50c3e93 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:18:40.642217 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: INFO nova.api.openstack.requestlog [None req-741da5fe-78f4-4269-81db-3d9aa50c3e93 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.559797 Aug 04 05:18:40.643089 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: [pid: 103950|app: 0|req: 29/56] 10.222.0.46 () {64 vars in 1235 bytes} [Thu Aug 4 05:18:40 2022] POST /compute/v2.1/flavors => generated 405 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 05:18:41.688890 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi [None req-10cd9ba7-9ed9-4142-a7bb-3c7df21e969c admin admin] Calling method '>' {{(pid=103949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:18:41.689917 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: INFO nova.api.openstack.requestlog [None req-10cd9ba7-9ed9-4142-a7bb-3c7df21e969c admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001492 Aug 04 05:18:41.690388 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: [pid: 103949|app: 0|req: 28/57] 10.222.0.46 () {56 vars in 1074 bytes} [Thu Aug 4 05:18:41 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:18:42.293076 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi [None req-0ed11f03-598b-4b14-b3c0-2f91411a138f admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:18:42.410180 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: INFO nova.api.openstack.requestlog [None req-0ed11f03-598b-4b14-b3c0-2f91411a138f admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.571053 Aug 04 05:18:42.410759 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: [pid: 103950|app: 0|req: 30/58] 10.222.0.46 () {64 vars in 1235 bytes} [Thu Aug 4 05:18:41 2022] POST /compute/v2.1/flavors => generated 407 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 04 05:18:43.474277 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi [None req-10cd9ba7-9ed9-4142-a7bb-3c7df21e969c admin admin] Calling method '>' {{(pid=103949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:18:43.475400 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: INFO nova.api.openstack.requestlog [None req-10cd9ba7-9ed9-4142-a7bb-3c7df21e969c admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001597 Aug 04 05:18:43.475906 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: [pid: 103949|app: 0|req: 29/59] 10.222.0.46 () {56 vars in 1074 bytes} [Thu Aug 4 05:18:43 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:18:44.195005 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi [None req-4aa7dba5-d6f3-4b03-9661-8862f1c86353 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:18:44.271320 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: INFO nova.api.openstack.requestlog [None req-4aa7dba5-d6f3-4b03-9661-8862f1c86353 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.562253 Aug 04 05:18:44.271885 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: [pid: 103950|app: 0|req: 31/60] 10.222.0.46 () {64 vars in 1235 bytes} [Thu Aug 4 05:18:43 2022] POST /compute/v2.1/flavors => generated 409 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 05:18:45.317634 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi [None req-10cd9ba7-9ed9-4142-a7bb-3c7df21e969c admin admin] Calling method '>' {{(pid=103949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:18:45.318724 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: INFO nova.api.openstack.requestlog [None req-10cd9ba7-9ed9-4142-a7bb-3c7df21e969c admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001471 Aug 04 05:18:45.319205 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: [pid: 103949|app: 0|req: 30/61] 10.222.0.46 () {56 vars in 1074 bytes} [Thu Aug 4 05:18:45 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 05:18:45.912373 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi [None req-01fc5e6e-55b2-4d41-9e97-6520c6e78130 admin admin] Calling method '>' {{(pid=103950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:18:45.934969 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: INFO nova.api.openstack.requestlog [None req-01fc5e6e-55b2-4d41-9e97-6520c6e78130 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.474187 Aug 04 05:18:45.935526 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: [pid: 103950|app: 0|req: 32/62] 10.222.0.46 () {60 vars in 1202 bytes} [Thu Aug 4 05:18:45 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 05:19:43.964563 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi [None req-10cd9ba7-9ed9-4142-a7bb-3c7df21e969c admin admin] Calling method '>' {{(pid=103949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:19:43.965587 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: INFO nova.api.openstack.requestlog [None req-10cd9ba7-9ed9-4142-a7bb-3c7df21e969c admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001466 Aug 04 05:19:43.965996 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: [pid: 103949|app: 0|req: 31/63] 10.222.0.46 () {54 vars in 931 bytes} [Thu Aug 4 05:19:43 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:19:43.977822 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG dbcounter [-] [103950] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=103950) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:19:44.487950 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi [None req-4ea7fa5b-4b49-4c9e-a2a6-50d02efad97d admin admin] Calling method '>' {{(pid=103950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:19:44.511059 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: INFO nova.api.openstack.requestlog [None req-4ea7fa5b-4b49-4c9e-a2a6-50d02efad97d admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.537730 Aug 04 05:19:44.511605 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: [pid: 103950|app: 0|req: 33/64] 10.222.0.46 () {60 vars in 1292 bytes} [Thu Aug 4 05:19:43 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 05:19:44.534563 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG dbcounter [-] [103949] Writing DB stats nova_api:SELECT=14 {{(pid=103949) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:19:44.539379 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi [None req-427ff0ca-4b6f-499b-b8d3-bec42754b3b1 admin admin] Calling method '>' {{(pid=103949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:19:44.547481 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: INFO nova.api.openstack.requestlog [None req-427ff0ca-4b6f-499b-b8d3-bec42754b3b1 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.015208 Aug 04 05:19:44.548051 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: [pid: 103949|app: 0|req: 32/65] 10.222.0.46 () {60 vars in 1283 bytes} [Thu Aug 4 05:19:44 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:19:44.565005 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi [None req-d9438bbb-2d64-4859-a619-f71f213d6c4a admin admin] Calling method '>' {{(pid=103950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:19:44.574892 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: INFO nova.api.openstack.requestlog [None req-d9438bbb-2d64-4859-a619-f71f213d6c4a admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.016562 Aug 04 05:19:44.575488 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: [pid: 103950|app: 0|req: 34/66] 10.222.0.46 () {60 vars in 1286 bytes} [Thu Aug 4 05:19:44 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:19:44.588262 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi [None req-4de3bc80-d502-4403-9e54-3dff21faeb09 admin admin] Calling method '>' {{(pid=103949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:19:44.597381 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: INFO nova.api.openstack.requestlog [None req-4de3bc80-d502-4403-9e54-3dff21faeb09 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012742 Aug 04 05:19:44.597968 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: [pid: 103949|app: 0|req: 33/67] 10.222.0.46 () {60 vars in 1286 bytes} [Thu Aug 4 05:19:44 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 05:19:44.614901 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi [None req-45142a52-28f3-4786-854f-3db7912754ca admin admin] Calling method '>' {{(pid=103950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:19:44.623649 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: INFO nova.api.openstack.requestlog [None req-45142a52-28f3-4786-854f-3db7912754ca admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.016667 Aug 04 05:19:44.624283 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: [pid: 103950|app: 0|req: 35/68] 10.222.0.46 () {60 vars in 1283 bytes} [Thu Aug 4 05:19:44 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:23:03.292533 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi [None req-4de3bc80-d502-4403-9e54-3dff21faeb09 admin admin] Calling method '>' {{(pid=103949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:23:03.293579 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: INFO nova.api.openstack.requestlog [None req-4de3bc80-d502-4403-9e54-3dff21faeb09 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001472 Aug 04 05:23:03.293971 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: [pid: 103949|app: 0|req: 34/69] 10.222.0.46 () {56 vars in 1074 bytes} [Thu Aug 4 05:23:03 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:23:03.434445 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG dbcounter [-] [103950] Writing DB stats nova_api:SELECT=6 {{(pid=103950) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:23:03.666040 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi [None req-5438a862-3cad-41a8-9cb5-af504c018da4 admin admin] Calling method '>' {{(pid=103950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:23:03.668437 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 05:23:03.668437 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: warnings.warn(msg) Aug 04 05:23:03.669647 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG oslo_concurrency.lockutils [None req-5438a862-3cad-41a8-9cb5-af504c018da4 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:23:03.670083 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG oslo_concurrency.lockutils [None req-5438a862-3cad-41a8-9cb5-af504c018da4 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:23:03.670899 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG oslo_concurrency.lockutils [None req-5438a862-3cad-41a8-9cb5-af504c018da4 admin admin] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:23:03.671321 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG oslo_concurrency.lockutils [None req-5438a862-3cad-41a8-9cb5-af504c018da4 admin admin] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:23:03.708802 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: INFO nova.api.openstack.requestlog [None req-5438a862-3cad-41a8-9cb5-af504c018da4 admin admin] 10.222.0.46 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.275072 Aug 04 05:23:03.709374 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: [pid: 103950|app: 0|req: 36/70] 10.222.0.46 () {60 vars in 1193 bytes} [Thu Aug 4 05:23:03 2022] GET /compute/v2.1/os-services => generated 791 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 05:23:04.570351 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi [None req-4de3bc80-d502-4403-9e54-3dff21faeb09 admin admin] Calling method '>' {{(pid=103949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:23:04.572533 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: INFO nova.api.openstack.requestlog [None req-4de3bc80-d502-4403-9e54-3dff21faeb09 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001735 Aug 04 05:23:04.572533 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: [pid: 103949|app: 0|req: 35/71] 10.222.0.46 () {56 vars in 1074 bytes} [Thu Aug 4 05:23:04 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:23:04.782208 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi [None req-f2617606-beb7-4fab-9f7c-64c21fcc6489 admin admin] Calling method '>' {{(pid=103950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:23:04.784932 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 05:23:04.784932 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: warnings.warn(msg) Aug 04 05:23:04.786736 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG oslo_concurrency.lockutils [None req-f2617606-beb7-4fab-9f7c-64c21fcc6489 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:23:04.787184 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG oslo_concurrency.lockutils [None req-f2617606-beb7-4fab-9f7c-64c21fcc6489 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:23:04.787985 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG oslo_concurrency.lockutils [None req-f2617606-beb7-4fab-9f7c-64c21fcc6489 admin admin] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:23:04.788416 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG oslo_concurrency.lockutils [None req-f2617606-beb7-4fab-9f7c-64c21fcc6489 admin admin] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:23:04.813294 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: INFO nova.api.openstack.requestlog [None req-f2617606-beb7-4fab-9f7c-64c21fcc6489 admin admin] 10.222.0.46 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.090627 Aug 04 05:23:04.817830 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: [pid: 103950|app: 0|req: 37/72] 10.222.0.46 () {60 vars in 1193 bytes} [Thu Aug 4 05:23:04 2022] GET /compute/v2.1/os-services => generated 791 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 05:23:16.123383 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi [None req-4de3bc80-d502-4403-9e54-3dff21faeb09 admin admin] Calling method '>' {{(pid=103949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:23:16.124543 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: INFO nova.api.openstack.requestlog [None req-4de3bc80-d502-4403-9e54-3dff21faeb09 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001538 Aug 04 05:23:16.125043 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: [pid: 103949|app: 0|req: 36/73] 10.222.0.46 () {56 vars in 1074 bytes} [Thu Aug 4 05:23:16 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:23:16.274559 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG dbcounter [-] [103950] Writing DB stats nova_cell0:SELECT=4 {{(pid=103950) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:23:16.275408 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG dbcounter [-] [103950] Writing DB stats nova_cell1:SELECT=4 {{(pid=103950) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:23:16.276051 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG dbcounter [-] [103950] Writing DB stats nova_api:SELECT=8 {{(pid=103950) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:23:16.333903 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi [None req-5b81eec4-7552-42fb-a3a1-69fb54119266 admin admin] Calling method '>' {{(pid=103950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:23:16.336649 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 05:23:16.336649 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: warnings.warn(msg) Aug 04 05:23:16.338199 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG oslo_concurrency.lockutils [None req-5b81eec4-7552-42fb-a3a1-69fb54119266 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:23:16.338719 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG oslo_concurrency.lockutils [None req-5b81eec4-7552-42fb-a3a1-69fb54119266 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:23:16.339554 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG oslo_concurrency.lockutils [None req-5b81eec4-7552-42fb-a3a1-69fb54119266 admin admin] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:23:16.340103 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG oslo_concurrency.lockutils [None req-5b81eec4-7552-42fb-a3a1-69fb54119266 admin admin] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:23:16.369155 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: INFO nova.api.openstack.requestlog [None req-5b81eec4-7552-42fb-a3a1-69fb54119266 admin admin] 10.222.0.46 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.099415 Aug 04 05:23:16.369746 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: [pid: 103950|app: 0|req: 38/74] 10.222.0.46 () {60 vars in 1193 bytes} [Thu Aug 4 05:23:16 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 05:23:17.321457 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: DEBUG nova.api.openstack.wsgi [None req-4de3bc80-d502-4403-9e54-3dff21faeb09 admin admin] Calling method '>' {{(pid=103949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:23:17.322500 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: INFO nova.api.openstack.requestlog [None req-4de3bc80-d502-4403-9e54-3dff21faeb09 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001544 Aug 04 05:23:17.322910 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: [pid: 103949|app: 0|req: 37/75] 10.222.0.46 () {56 vars in 1074 bytes} [Thu Aug 4 05:23:17 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:23:17.521431 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG nova.api.openstack.wsgi [None req-5738c31e-d14f-45d1-918a-70bbed09e9e7 admin admin] Calling method '>' {{(pid=103950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:23:17.524026 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 05:23:17.524026 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: warnings.warn(msg) Aug 04 05:23:17.525295 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG oslo_concurrency.lockutils [None req-5738c31e-d14f-45d1-918a-70bbed09e9e7 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:23:17.525733 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG oslo_concurrency.lockutils [None req-5738c31e-d14f-45d1-918a-70bbed09e9e7 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:23:17.526581 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG oslo_concurrency.lockutils [None req-5738c31e-d14f-45d1-918a-70bbed09e9e7 admin admin] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:23:17.527003 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: DEBUG oslo_concurrency.lockutils [None req-5738c31e-d14f-45d1-918a-70bbed09e9e7 admin admin] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:23:17.551917 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: INFO nova.api.openstack.requestlog [None req-5738c31e-d14f-45d1-918a-70bbed09e9e7 admin admin] 10.222.0.46 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.088072 Aug 04 05:23:17.552518 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: [pid: 103950|app: 0|req: 39/76] 10.222.0.46 () {60 vars in 1193 bytes} [Thu Aug 4 05:23:17 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 05:24:13.778746 dv-cinder-852072-1-iscsi devstack@n-api.service[103948]: Thu Aug 4 05:24:13 2022 - graceful shutdown triggered... Aug 04 05:24:13.779319 dv-cinder-852072-1-iscsi devstack@n-api.service[103949]: Gracefully killing worker 1 (pid: 103949)... Aug 04 05:24:13.780366 dv-cinder-852072-1-iscsi devstack@n-api.service[103950]: Gracefully killing worker 2 (pid: 103950)... Aug 04 05:24:13.781202 dv-cinder-852072-1-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Aug 04 05:24:14.779259 dv-cinder-852072-1-iscsi devstack@n-api.service[103948]: worker 1 buried after 1 seconds Aug 04 05:24:14.779767 dv-cinder-852072-1-iscsi devstack@n-api.service[103948]: worker 2 buried after 1 seconds Aug 04 05:24:14.779767 dv-cinder-852072-1-iscsi devstack@n-api.service[103948]: goodbye to uWSGI. Aug 04 05:24:14.780990 dv-cinder-852072-1-iscsi systemd[1]: devstack@n-api.service: Succeeded. Aug 04 05:24:14.781865 dv-cinder-852072-1-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Aug 04 05:24:14.786714 dv-cinder-852072-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 04 05:24:14.800730 dv-cinder-852072-1-iscsi devstack@n-api.service[118455]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 04 05:24:14.803717 dv-cinder-852072-1-iscsi devstack@n-api.service[118455]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Aug 4 05:24:14 2022] *** Aug 04 05:24:14.803717 dv-cinder-852072-1-iscsi devstack@n-api.service[118455]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 04 05:24:14.803717 dv-cinder-852072-1-iscsi devstack@n-api.service[118455]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 04 05:24:14.803717 dv-cinder-852072-1-iscsi devstack@n-api.service[118455]: nodename: dv-cinder-852072-1-iscsi Aug 04 05:24:14.803717 dv-cinder-852072-1-iscsi devstack@n-api.service[118455]: machine: x86_64 Aug 04 05:24:14.803717 dv-cinder-852072-1-iscsi devstack@n-api.service[118455]: clock source: unix Aug 04 05:24:14.803717 dv-cinder-852072-1-iscsi devstack@n-api.service[118455]: pcre jit disabled Aug 04 05:24:14.803717 dv-cinder-852072-1-iscsi devstack@n-api.service[118455]: detected number of CPU cores: 4 Aug 04 05:24:14.803717 dv-cinder-852072-1-iscsi devstack@n-api.service[118455]: current working directory: / Aug 04 05:24:14.803717 dv-cinder-852072-1-iscsi devstack@n-api.service[118455]: detected binary path: /usr/bin/uwsgi-core Aug 04 05:24:14.805082 dv-cinder-852072-1-iscsi devstack@n-api.service[118455]: your processes number limit is 47680 Aug 04 05:24:14.805082 dv-cinder-852072-1-iscsi devstack@n-api.service[118455]: your memory page size is 4096 bytes Aug 04 05:24:14.805082 dv-cinder-852072-1-iscsi devstack@n-api.service[118455]: detected max file descriptor number: 2048 Aug 04 05:24:14.805082 dv-cinder-852072-1-iscsi devstack@n-api.service[118455]: lock engine: pthread robust mutexes Aug 04 05:24:14.805082 dv-cinder-852072-1-iscsi devstack@n-api.service[118455]: thunder lock: enabled Aug 04 05:24:14.805082 dv-cinder-852072-1-iscsi devstack@n-api.service[118455]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 04 05:24:14.805082 dv-cinder-852072-1-iscsi devstack@n-api.service[118455]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 04 05:24:14.853418 dv-cinder-852072-1-iscsi devstack@n-api.service[118455]: Python main interpreter initialized at 0x55a6089139c0 Aug 04 05:24:14.853418 dv-cinder-852072-1-iscsi devstack@n-api.service[118455]: python threads support enabled Aug 04 05:24:14.853418 dv-cinder-852072-1-iscsi devstack@n-api.service[118455]: your server socket listen backlog is limited to 100 connections Aug 04 05:24:14.853418 dv-cinder-852072-1-iscsi devstack@n-api.service[118455]: your mercy for graceful operations on workers is 90 seconds Aug 04 05:24:14.853907 dv-cinder-852072-1-iscsi devstack@n-api.service[118455]: mapped 403077 bytes (393 KB) for 2 cores Aug 04 05:24:14.853907 dv-cinder-852072-1-iscsi devstack@n-api.service[118455]: *** Operational MODE: preforking *** Aug 04 05:24:14.854223 dv-cinder-852072-1-iscsi devstack@n-api.service[118455]: *** uWSGI is running in multiple interpreter mode *** Aug 04 05:24:14.854223 dv-cinder-852072-1-iscsi devstack@n-api.service[118455]: spawned uWSGI master process (pid: 118455) Aug 04 05:24:14.854528 dv-cinder-852072-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 04 05:24:14.855904 dv-cinder-852072-1-iscsi devstack@n-api.service[118455]: spawned uWSGI worker 1 (pid: 118476, cores: 1) Aug 04 05:24:14.855904 dv-cinder-852072-1-iscsi devstack@n-api.service[118455]: spawned uWSGI worker 2 (pid: 118477, cores: 1) Aug 04 05:24:14.856225 dv-cinder-852072-1-iscsi devstack@n-api.service[118455]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 04 05:24:15.532761 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 04 05:24:15.574501 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 04 05:24:16.716275 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 04 05:24:16.716275 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: from cryptography.utils import int_from_bytes Aug 04 05:24:16.717208 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 04 05:24:16.717208 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: from cryptography.utils import int_from_bytes Aug 04 05:24:16.772063 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 04 05:24:16.772063 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: from cryptography.utils import int_from_bytes Aug 04 05:24:16.772634 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 04 05:24:16.772634 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: from cryptography.utils import int_from_bytes Aug 04 05:24:19.121819 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 04 05:24:19.122701 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 04 05:24:19.123424 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 04 05:24:19.123994 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 04 05:24:19.124420 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 04 05:24:19.125001 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:24:19.125549 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:24:19.126055 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:24:19.126592 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:24:19.127090 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:24:19.127580 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:24:19.128082 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:24:19.128574 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:24:19.129083 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:24:19.129523 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:24:19.130002 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:24:19.130534 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-852072-1-iscsi {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:24:19.131033 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:24:19.131553 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:24:19.132031 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:24:19.132526 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:24:19.133003 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:24:19.133502 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:24:19.133990 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:24:19.134818 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:24:19.135369 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:24:19.135842 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:24:19.136306 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:24:19.136867 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:24:19.137350 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:24:19.137890 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:24:19.138428 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:24:19.138918 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:24:19.139419 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:24:19.139900 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:24:19.140483 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-852072-1-iscsi {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:24:19.140981 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:24:19.141466 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:24:19.141947 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:24:19.142581 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:24:19.143119 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:24:19.143679 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:24:19.144179 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:24:19.144675 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:24:19.145144 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:24:19.145658 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:24:19.146156 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:24:19.146682 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:24:19.147183 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:24:19.147659 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:24:19.148131 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:24:19.148617 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:24:19.149113 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:24:19.149597 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:24:19.150075 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:24:19.150520 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:24:19.151559 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:24:19.152041 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:24:19.152528 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:24:19.153106 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:24:19.153539 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:24:19.153987 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:24:19.154522 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:24:19.155015 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:24:19.155516 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:24:19.155990 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:24:19.156471 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:24:19.156951 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:24:19.157430 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:24:19.157907 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:24:19.158403 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:24:19.158892 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:24:19.159383 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:24:19.159865 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:24:19.160333 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:24:19.161064 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:24:19.161540 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:24:19.162095 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.46 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:24:19.162551 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.46 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:24:19.163032 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:24:19.163519 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:24:19.163994 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:24:19.164457 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:24:19.164932 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:24:19.165409 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:24:19.165876 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:24:19.166370 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:24:19.167472 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:24:19.167966 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:24:19.168624 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:24:19.169113 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:24:19.169517 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:24:19.169978 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:24:19.170480 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:24:19.170988 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:24:19.171460 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:24:19.171932 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:24:19.172414 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:24:19.172883 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:24:19.173372 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:24:19.173842 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:24:19.174359 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:24:19.174863 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:24:19.175332 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:24:19.175802 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:24:19.176293 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:24:19.176798 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:24:19.177280 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:24:19.177772 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:24:19.178257 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:24:19.178773 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:24:19.179256 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:24:19.179737 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:24:19.180217 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:24:19.180726 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:24:19.181195 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:24:19.181676 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:24:19.182162 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:24:19.183352 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:24:19.183839 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:24:19.184337 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:24:19.184829 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:24:19.185310 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:24:19.185796 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:24:19.186886 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:24:19.187365 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:24:19.187861 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:24:19.188335 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:24:19.188820 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:24:19.189299 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:24:19.189791 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:24:19.190384 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:24:19.190873 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:24:19.191341 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:24:19.191820 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:24:19.192303 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:24:19.192801 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:24:19.193298 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:24:19.193777 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:24:19.194332 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:24:19.194810 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:24:19.195323 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:24:19.195838 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.196342 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.196848 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.197328 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.197850 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.198971 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.199476 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.199963 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.200455 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.200955 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.201441 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.201932 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.202435 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.202932 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.203423 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.203916 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.204420 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.204916 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.205464 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.205950 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.206494 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.206992 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.207499 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.207974 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.208479 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.208989 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.209467 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.209964 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.210521 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.211013 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.211522 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.211997 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.212494 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.213009 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.214038 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.214580 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.215075 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.215559 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.216121 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.216610 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.217096 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.217614 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.218096 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.218615 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.219107 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.219600 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.220083 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.220556 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.221028 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.221508 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.221977 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.222483 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.223018 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.223504 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.223989 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.224489 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.224979 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.225494 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.225963 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.226474 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.226949 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.227517 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.228003 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.228492 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.228977 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.230035 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.230562 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.231054 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.231541 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.232040 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.232511 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.232990 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.233481 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.234035 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.234642 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.235123 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.235598 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.236114 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.236592 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.237070 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.237584 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.238090 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.238635 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.239145 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.239635 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.240136 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.240617 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.241090 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.241570 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.242049 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.242546 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.243042 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.243510 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.243979 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.244540 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.245546 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.245999 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.246552 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.247045 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.247516 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.247983 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.248459 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.248968 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.249449 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.249958 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.250486 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.250983 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.251536 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.252037 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.252517 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.253001 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.253477 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.253962 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.254463 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.254968 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.255449 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.256018 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.256503 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.257008 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.257492 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.257989 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.258481 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.258963 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.259486 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.259994 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.261035 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.261831 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.262695 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.263352 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.263848 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.264344 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.264822 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.265325 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.265825 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.266340 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.266826 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.267323 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.267834 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.268314 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.268814 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.269293 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.269783 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.270292 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.270859 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.271334 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.271802 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.272333 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.272808 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.273387 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.273887 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.274419 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.274893 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.275389 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.275867 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.276447 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.277215 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.277699 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.278183 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.278681 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.279170 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.279660 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.280184 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.280680 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.281162 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.281660 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.282146 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.282673 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.283141 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.283626 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.284116 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.284675 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.285175 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.285916 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.286485 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.286962 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.287433 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.287935 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.288422 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.288894 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.289389 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.289861 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.290380 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.290883 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.291402 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.291957 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.292447 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.293035 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.293514 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.293991 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.294526 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.295021 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.295516 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.295990 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.296469 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.296944 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.297431 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.298201 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.298749 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.299234 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.299718 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.300205 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.300704 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.301216 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.301710 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.302212 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.302730 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.303305 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.303788 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.304257 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.304745 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.305225 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.305708 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.306178 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.306700 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.307012 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.308215 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.308759 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.309262 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.309750 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.310233 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.310751 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.311223 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.311717 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.312221 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.312690 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.313238 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.313721 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.314245 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.314738 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.315268 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.315764 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.316269 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.316739 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.317120 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 04 05:24:19.317915 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.317915 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.318172 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 04 05:24:19.318361 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.318361 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.318641 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.318796 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 04 05:24:19.318942 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.319747 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.319917 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 04 05:24:19.320067 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.320203 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 04 05:24:19.320377 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.320377 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.320620 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:24:19.320749 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.320749 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.321009 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:24:19.321143 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.321344 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.321502 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:24:19.321957 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.322072 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:24:19.322564 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.322731 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:24:19.323256 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.323743 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.323998 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:24:19.324447 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.324582 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:24:19.325028 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.325155 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:24:19.325614 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.325736 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:24:19.326169 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:24:19.326404 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.326552 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.326934 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:24:19.327096 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.327253 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.327398 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-852072-1-iscsi {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:24:19.327540 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.327993 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.328143 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:24:19.328282 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.328413 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.328556 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:24:19.329053 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.329053 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.329532 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:24:19.329789 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.330032 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:24:19.330296 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.330296 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.330792 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:24:19.331037 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.331280 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:24:19.331523 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.331763 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:24:19.332027 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.332027 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.332027 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.332845 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:24:19.333174 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.333446 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:24:19.333699 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.333996 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:24:19.334241 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.334241 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.335733 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:24:19.335969 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.335969 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.336443 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:24:19.336712 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.336712 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.337183 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:24:19.337580 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.337813 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:24:19.338039 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.338039 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.339074 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:24:19.339322 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.339573 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:24:19.339823 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.339823 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.340285 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:24:19.340587 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.340827 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:24:19.341069 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.341322 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-852072-1-iscsi {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:24:19.341568 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.341568 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.342017 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:24:19.342245 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.342501 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:24:19.342813 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.343063 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:24:19.343300 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.343300 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.343741 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:24:19.343977 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.344201 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:24:19.344453 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.345770 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:24:19.346027 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.346258 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:24:19.346597 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.346842 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:24:19.347086 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.347323 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:24:19.347574 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.347944 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:24:19.348181 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.348422 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:24:19.348668 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.348668 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.349083 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:24:19.349321 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.349546 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:24:19.349806 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.350031 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:24:19.350267 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.350530 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:24:19.350782 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.351016 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:24:19.351283 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.351536 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:24:19.351980 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.351980 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.352474 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:24:19.352718 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.353037 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:24:19.353267 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.353267 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.353685 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:24:19.354124 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.354477 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:24:19.354728 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.354728 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.356277 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:24:19.356550 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.356550 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.357012 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:24:19.357250 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.357250 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.357697 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:24:19.357952 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.358401 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:24:19.358671 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.358914 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:24:19.359159 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.359159 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.359619 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:24:19.359856 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.360083 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:24:19.360309 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.360309 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.360740 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:24:19.360980 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.361214 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:24:19.361447 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.361684 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:24:19.361919 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.361919 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.362382 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:24:19.362626 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.362626 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.363126 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:24:19.363348 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.363573 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:24:19.363809 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.363809 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.364255 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:24:19.364491 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.364491 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.364930 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:24:19.366109 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.366109 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.366792 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:24:19.367030 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.367354 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:24:19.367592 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.367948 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:24:19.368205 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.368205 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.368854 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:24:19.369105 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.369341 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:24:19.369575 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.369575 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.369575 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.370851 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.46 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:24:19.371090 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.371336 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.46 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:24:19.371569 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.371569 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.372119 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:24:19.372367 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.372367 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.372830 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:24:19.373130 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.373130 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.373611 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:24:19.373859 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.373859 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.374354 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:24:19.374607 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.374607 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.375085 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:24:19.375345 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.376468 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:24:19.376930 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.376930 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.377405 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:24:19.377647 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.377647 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.378137 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:24:19.378397 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.378660 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:24:19.379045 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.379045 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.379484 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:24:19.379723 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.379723 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.380154 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:24:19.380396 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.380396 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.380839 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:24:19.381104 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.381323 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:24:19.381559 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.381559 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.382003 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:24:19.382241 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.382523 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:24:19.382754 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.382754 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.383264 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:24:19.383501 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.383501 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.383986 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:24:19.384223 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.384460 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:24:19.384737 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.384737 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.385200 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:24:19.385507 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.385507 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.386918 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:24:19.387310 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.387310 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.387733 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:24:19.387945 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.387945 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.388367 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:24:19.388589 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.388589 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.389215 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:24:19.390412 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.390679 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:24:19.390915 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.390915 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.391387 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:24:19.391637 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.391637 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.392127 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:24:19.392656 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.392656 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.393145 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:24:19.393624 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.393624 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.394225 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:24:19.394485 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.394485 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.394912 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:24:19.395140 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.395355 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:24:19.395621 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.395621 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.395621 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.395621 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.397593 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:24:19.397860 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.397860 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.398502 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:24:19.398765 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.399013 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:24:19.399488 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.399488 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.399974 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:24:19.400282 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.400282 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.400760 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:24:19.401527 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.401527 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.402019 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:24:19.402263 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.402574 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:24:19.402808 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.402808 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.403272 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:24:19.403802 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.403802 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.404297 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:24:19.404543 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.404543 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.405002 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:24:19.405308 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.405308 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.405779 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:24:19.406084 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.406084 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.407420 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:24:19.407875 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.407875 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.408374 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:24:19.408624 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.408624 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.409090 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:24:19.409323 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.409323 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.411069 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:24:19.411340 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.411340 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.411799 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:24:19.412043 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.412043 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.412730 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:24:19.412986 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.412986 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.413438 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:24:19.413985 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.414442 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:24:19.414681 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.414681 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.414681 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.415329 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:24:19.415478 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.415478 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.415867 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:24:19.416011 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.416153 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:24:19.416299 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.416299 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.416586 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:24:19.416892 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.416892 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.417796 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:24:19.418044 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.418190 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:24:19.418359 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.418359 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.418625 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:24:19.418758 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.418758 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.419032 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:24:19.419184 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.419184 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.419462 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:24:19.419603 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.419603 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.419882 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:24:19.420013 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.420013 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.420270 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:24:19.420402 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.420645 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:24:19.420800 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.420800 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.421057 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:24:19.421195 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.421195 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.421468 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 05:24:19.421613 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.421613 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.421878 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.422016 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.422230 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.422385 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.422385 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.422669 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.422815 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.422970 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.423108 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.423108 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.423358 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.423570 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.423717 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.423899 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.424056 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.424186 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.424333 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.424463 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.424594 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.424735 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.424874 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.425013 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.425152 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.425297 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.425439 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.425568 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.425700 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.425830 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.425978 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.426111 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.426253 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.426421 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.426565 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.426696 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.426828 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.426961 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.427111 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.427790 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.427953 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.428085 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.428281 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.428473 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.428616 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.428616 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.428881 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.429013 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.429147 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.429360 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.429504 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.429645 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.429786 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.429927 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.430057 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.430210 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.430383 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.430517 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.430653 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.430785 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.430976 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.431137 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.431270 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.431417 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.431558 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.431687 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.431817 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.431968 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.432106 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.432106 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.432927 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.433081 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.433261 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.433392 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.433523 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.433654 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.433792 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.433923 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.434070 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.434216 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.434464 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.434464 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.434728 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.434860 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.435005 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.435146 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.435277 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.435408 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.435539 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.435679 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.435819 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.435949 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.436080 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.436225 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.436357 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.436559 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.436761 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.436912 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.437051 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.438451 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.438671 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.438827 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.438963 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.439091 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.439233 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.439356 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.439475 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.439618 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.439748 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.439873 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.439991 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.440121 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.440251 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.440386 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.440505 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.440625 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.440746 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.440868 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.441020 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.441145 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.441276 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.441407 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.441524 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.441640 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.441783 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.441907 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.442042 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.442178 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.442339 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.442485 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.442485 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.442731 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.442864 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.442983 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.443109 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.443232 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.443378 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.443521 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.443658 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.443792 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.443923 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.444067 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.444210 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.444354 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.444484 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.444615 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.444738 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.444875 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.445008 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.445152 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.445281 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.445412 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.445554 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.445700 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.445830 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.445960 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.446091 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.446233 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.446386 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.448309 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.448775 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.448775 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.449228 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.449374 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.449528 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.449661 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.449802 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.449944 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.450088 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.450219 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.450658 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.450854 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.451042 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.451218 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.451351 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.451562 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.451562 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.451983 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.452126 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.452268 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.452407 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.452537 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.452680 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.452815 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.452953 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.453092 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.453222 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.453370 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.453510 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.453642 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.453780 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.453910 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.454049 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.454196 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.454373 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.454524 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.454657 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.454801 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.454941 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.454941 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.455278 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.455409 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.455550 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.455550 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.455805 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.455947 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.456087 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.456218 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.456358 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.456503 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.456670 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.456809 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.456958 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.457096 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.457225 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.457357 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.457499 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.457641 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.457837 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.457976 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.458118 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.458354 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.458568 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.459056 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.459208 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.459341 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.459474 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.459617 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.459748 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.459880 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.460039 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.460182 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.460313 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.460534 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.460666 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.460797 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.460929 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.461059 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.461206 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.461353 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.461492 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.461639 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.461788 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.461929 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.462058 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.462209 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.462371 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.462529 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.462659 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.462800 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.462950 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.463089 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.463221 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.463394 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.464071 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.464071 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.464071 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.464071 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.464678 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.464814 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.464947 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.465079 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.465218 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.465369 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.465503 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.465641 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.465789 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.465935 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.466073 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.466206 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.466462 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.466603 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.466755 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.466885 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.467020 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.467161 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.467304 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.467435 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.467583 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.467714 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.467845 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.468051 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.468186 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.468339 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.468473 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.468678 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.468678 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.468678 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.468678 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.468678 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.469730 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.469863 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.469994 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.470134 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.470264 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.470435 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.470595 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.470729 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.470862 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.470993 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.471126 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.471269 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.471409 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.471540 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.471680 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.471823 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.471968 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.472112 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.472266 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.472397 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.472538 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.472677 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.472819 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.472959 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.473100 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.473230 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.473370 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.473511 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.473660 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.473801 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.473944 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.474075 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.474213 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.474377 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.474570 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.474703 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.474846 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.474986 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.475128 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.475280 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.475406 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.475534 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.475666 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.475793 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.475924 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.476075 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.476206 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.476338 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.476467 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.476599 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.476741 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.476889 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.477021 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.477162 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.477303 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.477447 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.477578 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.477728 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.477863 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.478003 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.478190 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.478502 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.478656 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.478799 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.479005 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.479550 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.479738 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.479908 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.480055 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.480205 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.480356 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.480492 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.480627 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.480766 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.480909 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.481051 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.481051 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.481305 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.481445 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.481575 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.481793 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.481925 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.482069 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.482259 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.482477 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.482659 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.482793 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.482927 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.483069 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.483201 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.483340 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.483483 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.483613 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.483818 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.483818 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.484102 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.484237 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.484385 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.484518 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.484651 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.484826 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.484957 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.485100 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.485243 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.485375 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.485507 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.485698 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.485845 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.486001 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.486141 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.486280 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.486440 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.486574 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.486722 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.486852 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.486992 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.487132 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.487274 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.487274 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.487513 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.487650 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.487790 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.487917 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.488066 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.488209 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.488342 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.488473 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.488601 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.488730 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.488875 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.489008 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.489140 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.489273 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.489273 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.489855 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.490013 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.490146 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.490279 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.490438 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.490576 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.490728 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.490872 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.491014 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.491160 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.491297 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.491441 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.491595 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.491735 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.491866 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 04 05:24:19.492010 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.492010 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.492010 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.492010 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.492010 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.492010 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.492010 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.492010 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.493008 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.493008 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.493008 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.493008 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.493008 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.493008 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.493008 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.493008 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.494030 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.494030 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.494030 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.494030 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.494030 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.494030 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.494030 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.494030 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.495927 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.495927 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.495927 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.495927 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.495927 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.495927 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.495927 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.495927 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.496933 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.496933 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.496933 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.496933 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.496933 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.496933 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.496933 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.496933 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.497942 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.497942 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.497942 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.497942 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.497942 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.497942 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.497942 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.497942 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.498970 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.498970 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.498970 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.498970 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.498970 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.498970 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.498970 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.498970 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.500487 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.500487 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.500487 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.500487 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.500487 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.500487 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.500487 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.500487 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.501484 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.501484 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.501484 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.501484 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.501484 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.501484 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.501484 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.501484 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.502593 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.502593 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.502593 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.502593 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.502593 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.502593 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.502593 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.502593 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.503601 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.503601 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.503601 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.503601 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.503601 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.503601 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.503601 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.503601 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.504623 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.504623 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.504623 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.504623 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.504623 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.504623 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.504623 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.504623 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.505646 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.505646 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.505646 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.505646 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.505646 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.505646 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.505646 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.505646 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.506804 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.506804 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.506804 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.506804 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.506804 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.506804 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.506804 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.506804 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.507920 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.507920 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.507920 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.507920 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.507920 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.507920 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.507920 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.507920 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.508894 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.508894 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.508894 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.508894 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.508894 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.508894 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.508894 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.508894 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.510719 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.510719 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.510719 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.510719 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.510719 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.511367 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.511367 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.511773 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.512097 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.512417 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.512749 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.513079 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.513414 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.513732 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.514065 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.514410 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.514742 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.515074 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.515393 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.515716 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.516029 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.516362 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.516688 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.517012 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.517341 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.517784 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.518114 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.518464 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.518799 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.519132 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.519452 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.519760 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.520083 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.520584 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.520777 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.521012 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.521321 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.521642 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.521961 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.522279 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.522613 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.522926 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.523261 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.523574 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.523905 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.524300 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.524580 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.524881 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.525196 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.525522 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.525844 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.526489 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.526798 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.527115 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.527475 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.527790 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.528123 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.528465 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.528805 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.529125 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.529465 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.529805 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.530127 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.530517 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.530978 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.531122 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.531427 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.531745 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.532583 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.532583 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.532893 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.533032 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.533250 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.533562 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.533875 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.534208 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.534545 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.534871 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.535189 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.535502 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.536076 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.536385 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.536744 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.537054 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.537391 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.537708 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.538040 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.538387 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.538714 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.539037 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.539359 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.539680 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.540006 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.540326 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.540788 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.541155 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.541333 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.542114 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.542748 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.543172 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.543412 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.543737 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.544057 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.544380 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.544703 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.545023 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.545345 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.545661 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.545978 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.546350 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.546704 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.547023 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.547370 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.547702 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.548027 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.548351 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.548675 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.549051 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.549375 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.549688 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.550027 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.550365 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.550692 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.551019 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.551421 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.551632 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.551942 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.552260 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.552580 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.552894 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.553214 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.553553 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.553900 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.554227 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.554575 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.554894 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.555216 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.555803 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.556127 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.556473 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.556808 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.557140 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.557525 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.557885 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.558191 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.558533 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.558846 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.559165 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.559480 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.559790 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.560119 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.560445 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.560759 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.561087 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.561647 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.561987 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.562370 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.562704 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.563038 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.563370 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.563686 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.563997 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.564325 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.564634 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.564944 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.565264 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.565582 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.565892 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.566200 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.566539 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.566853 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.567170 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.567480 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.567786 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.568127 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.568436 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.568741 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.569047 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.569363 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.569672 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.569979 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.570290 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.570627 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.570945 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.571262 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.571644 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.571889 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.572199 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.572509 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.573356 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.573664 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.573997 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.574338 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.574682 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.575010 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.575324 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.575656 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.575971 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.576286 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.576642 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.576960 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.577557 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.577893 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.578220 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.578595 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.578932 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.579244 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.579556 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.579865 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.580194 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.580509 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.580828 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.581189 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.581467 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.581847 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.582093 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.582430 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.582751 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.583062 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.583376 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.583692 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.584004 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.584316 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.584626 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.584943 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.585296 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.585619 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.585939 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.586257 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.586601 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.586916 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.587230 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.587549 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.587859 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.588179 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.588598 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.588932 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.589235 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.589674 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.589995 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.590426 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.590668 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.590989 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.591311 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.591638 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.592024 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.592281 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.592595 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.592925 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.593273 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.593600 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.593929 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.594237 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.594585 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.594873 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.595187 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.595506 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.595820 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.596128 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.596431 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.596744 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.597050 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.597359 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.597672 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.597974 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.598285 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.598614 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.598931 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.599228 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.599533 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.599839 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.600144 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.600456 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.600761 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.601081 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.601381 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.601696 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.602001 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.602371 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.602685 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.603004 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.603334 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.603645 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.603970 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.604909 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.605240 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.605567 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.605894 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.606210 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.606573 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.606889 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.607205 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.607521 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.607837 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.608149 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.608472 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.608809 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.609137 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.609447 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.609779 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.610101 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.610882 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.610882 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.611200 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.614367 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.614367 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.614367 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.614367 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.614367 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.614367 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.614367 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.614367 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.615371 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.615371 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.615371 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.615371 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.615371 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.615371 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.616188 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.616188 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.616452 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.617579 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.617579 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.617579 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.617909 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.617909 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.618229 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 05:24:19.618503 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 04 05:24:19.624539 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO dbcounter [None req-2d8a8c2c-8613-4d4f-9d33-a3cc781bcaf2 None None] Registered counter for database nova_api Aug 04 05:24:19.648453 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_db.sqlalchemy.engines [None req-2d8a8c2c-8613-4d4f-9d33-a3cc781bcaf2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118477) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 04 05:24:19.658241 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG dbcounter [-] [118477] Writer thread running {{(pid=118477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 04 05:24:19.721197 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.context [None req-2d8a8c2c-8613-4d4f-9d33-a3cc781bcaf2 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),36d37866-0ef0-448b-8699-3d2b86be0706(cell1) {{(pid=118477) load_cells /opt/stack/nova/nova/context.py:464}} Aug 04 05:24:19.725761 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-2d8a8c2c-8613-4d4f-9d33-a3cc781bcaf2 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:24:19.727487 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-2d8a8c2c-8613-4d4f-9d33-a3cc781bcaf2 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:24:19.728411 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-2d8a8c2c-8613-4d4f-9d33-a3cc781bcaf2 None None] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:24:19.731174 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-2d8a8c2c-8613-4d4f-9d33-a3cc781bcaf2 None None] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:24:19.733362 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO dbcounter [None req-2d8a8c2c-8613-4d4f-9d33-a3cc781bcaf2 None None] Registered counter for database nova_cell0 Aug 04 05:24:19.737732 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO dbcounter [None req-2d8a8c2c-8613-4d4f-9d33-a3cc781bcaf2 None None] Registered counter for database nova_cell1 Aug 04 05:24:19.747519 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_db.sqlalchemy.engines [None req-2d8a8c2c-8613-4d4f-9d33-a3cc781bcaf2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118477) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 04 05:24:19.749391 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_db.sqlalchemy.engines [None req-2d8a8c2c-8613-4d4f-9d33-a3cc781bcaf2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118477) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 04 05:24:19.761424 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG dbcounter [-] [118477] Writer thread running {{(pid=118477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 04 05:24:19.765346 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG dbcounter [-] [118477] Writer thread running {{(pid=118477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 04 05:24:19.773614 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO dbcounter [None req-1e297774-4a16-44ac-9356-15871f26b9c5 None None] Registered counter for database nova_api Aug 04 05:24:19.796266 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_db.sqlalchemy.engines [None req-1e297774-4a16-44ac-9356-15871f26b9c5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118476) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 04 05:24:19.803464 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG dbcounter [-] [118476] Writer thread running {{(pid=118476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 04 05:24:19.865179 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.context [None req-1e297774-4a16-44ac-9356-15871f26b9c5 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),36d37866-0ef0-448b-8699-3d2b86be0706(cell1) {{(pid=118476) load_cells /opt/stack/nova/nova/context.py:464}} Aug 04 05:24:19.869626 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-1e297774-4a16-44ac-9356-15871f26b9c5 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:24:19.875155 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-1e297774-4a16-44ac-9356-15871f26b9c5 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:24:19.875155 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-1e297774-4a16-44ac-9356-15871f26b9c5 None None] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:24:19.875155 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-1e297774-4a16-44ac-9356-15871f26b9c5 None None] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:24:19.877105 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO dbcounter [None req-1e297774-4a16-44ac-9356-15871f26b9c5 None None] Registered counter for database nova_cell0 Aug 04 05:24:19.882124 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO dbcounter [None req-1e297774-4a16-44ac-9356-15871f26b9c5 None None] Registered counter for database nova_cell1 Aug 04 05:24:19.891671 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_db.sqlalchemy.engines [None req-1e297774-4a16-44ac-9356-15871f26b9c5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118476) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 04 05:24:19.894372 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_db.sqlalchemy.engines [None req-1e297774-4a16-44ac-9356-15871f26b9c5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118476) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 04 05:24:19.903565 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG dbcounter [-] [118476] Writer thread running {{(pid=118476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 04 05:24:19.907274 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG dbcounter [-] [118476] Writer thread running {{(pid=118476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 04 05:24:19.981937 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO dbcounter [None req-2d8a8c2c-8613-4d4f-9d33-a3cc781bcaf2 None None] Registered counter for database nova_cell0 Aug 04 05:24:20.013024 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_db.sqlalchemy.engines [None req-2d8a8c2c-8613-4d4f-9d33-a3cc781bcaf2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118477) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 04 05:24:20.013024 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG dbcounter [-] [118477] Writer thread running {{(pid=118477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 04 05:24:20.066013 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO dbcounter [None req-1e297774-4a16-44ac-9356-15871f26b9c5 None None] Registered counter for database nova_cell0 Aug 04 05:24:20.075880 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_db.sqlalchemy.engines [None req-1e297774-4a16-44ac-9356-15871f26b9c5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118476) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 04 05:24:20.081134 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG dbcounter [-] [118476] Writer thread running {{(pid=118476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 04 05:24:20.382337 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: WARNING keystonemiddleware.auth_token [None req-2d8a8c2c-8613-4d4f-9d33-a3cc781bcaf2 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 04 05:24:20.392570 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: WARNING keystonemiddleware.auth_token [None req-2d8a8c2c-8613-4d4f-9d33-a3cc781bcaf2 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 04 05:24:20.421807 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: WARNING keystonemiddleware.auth_token [None req-1e297774-4a16-44ac-9356-15871f26b9c5 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 04 05:24:20.429511 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: WARNING keystonemiddleware.auth_token [None req-1e297774-4a16-44ac-9356-15871f26b9c5 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 04 05:24:20.766958 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: WARNING keystonemiddleware.auth_token [None req-2d8a8c2c-8613-4d4f-9d33-a3cc781bcaf2 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 04 05:24:20.778117 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: WARNING keystonemiddleware.auth_token [None req-2d8a8c2c-8613-4d4f-9d33-a3cc781bcaf2 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 04 05:24:20.784930 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55a6089139c0 pid: 118477 (default app) Aug 04 05:24:20.785163 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: WARNING keystonemiddleware.auth_token [None req-1e297774-4a16-44ac-9356-15871f26b9c5 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 04 05:24:20.791764 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: WARNING keystonemiddleware.auth_token [None req-1e297774-4a16-44ac-9356-15871f26b9c5 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 04 05:24:20.798336 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55a6089139c0 pid: 118476 (default app) Aug 04 05:24:59.863632 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG dbcounter [-] [118477] Writing DB stats nova_api:SELECT=3 {{(pid=118477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:24:59.864434 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG dbcounter [-] [118477] Writing DB stats nova_cell0:SELECT=3 {{(pid=118477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:24:59.865437 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG dbcounter [-] [118477] Writing DB stats nova_cell1:SELECT=3 {{(pid=118477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:24:59.866179 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG dbcounter [-] [118477] Writing DB stats nova_cell0:SELECT=3 {{(pid=118477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:25:02.180093 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-2d407554-6984-45c0-a8a3-d306796ae319 tempest-VolumesSnapshotsTestJSON-1086442173 tempest-VolumesSnapshotsTestJSON-1086442173-project] Action: 'create', calling method: .version_select at 0x7f147759ed30>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-601330194"}} {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:25:05.239021 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-2d407554-6984-45c0-a8a3-d306796ae319 tempest-VolumesSnapshotsTestJSON-1086442173 tempest-VolumesSnapshotsTestJSON-1086442173-project] 10.222.0.46 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 5.400653 Aug 04 05:25:05.240361 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 1/1] 10.222.0.46 () {60 vars in 1155 bytes} [Thu Aug 4 05:24:59 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 5405 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 04 05:25:05.261992 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-c4807cda-36c6-47a0-912d-de102caa337a tempest-VolumesSnapshotsTestJSON-1086442173 tempest-VolumesSnapshotsTestJSON-1086442173-project] Calling method '.version_select at 0x7f14773f7b80>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:25:05.388717 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-7fd6cdaa-e5d8-44a2-8ba9-7bf5f7275eec tempest-VolumesTestJSON-286556406 tempest-VolumesTestJSON-286556406-project] Calling method '.version_select at 0x7f14776578b0>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:25:05.466736 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG dbcounter [-] [118476] Writing DB stats nova_api:SELECT=3 {{(pid=118476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:25:05.473536 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG dbcounter [-] [118476] Writing DB stats nova_cell0:SELECT=3 {{(pid=118476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:25:05.475027 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG dbcounter [-] [118476] Writing DB stats nova_cell1:SELECT=3 {{(pid=118476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:25:05.476282 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG dbcounter [-] [118476] Writing DB stats nova_cell0:SELECT=3 {{(pid=118476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:25:06.304975 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-c4807cda-36c6-47a0-912d-de102caa337a tempest-VolumesSnapshotsTestJSON-1086442173 tempest-VolumesSnapshotsTestJSON-1086442173-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/9696a9eb-21e7-4153-b7e2-99e4abbae478" status: 200 len: 345 microversion: 2.1 time: 1.046314 Aug 04 05:25:06.313406 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 2/2] 10.222.0.46 () {58 vars in 1245 bytes} [Thu Aug 4 05:25:05 2022] GET /compute/v2.1/os-volumes/9696a9eb-21e7-4153-b7e2-99e4abbae478 => generated 345 bytes in 1050 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 05:25:06.327906 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-6f158b5d-c0c6-4e3c-bf4b-301eb3777f85 tempest-VolumesSnapshotsTestJSON-1086442173 tempest-VolumesSnapshotsTestJSON-1086442173-project] Action: 'create', calling method: .version_select at 0x7f147740e1f0>, body: {"snapshot": {"volume_id": "9696a9eb-21e7-4153-b7e2-99e4abbae478", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1493154919"}} {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:25:06.588742 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-7fd6cdaa-e5d8-44a2-8ba9-7bf5f7275eec tempest-VolumesTestJSON-286556406 tempest-VolumesTestJSON-286556406-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/784face6-b226-447d-81a5-cdb913e7b0c1" status: 200 len: 351 microversion: 2.1 time: 1.889878 Aug 04 05:25:06.591193 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 1/3] 10.222.0.46 () {58 vars in 1245 bytes} [Thu Aug 4 05:25:04 2022] GET /compute/v2.1/os-volumes/784face6-b226-447d-81a5-cdb913e7b0c1 => generated 351 bytes in 1894 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:25:08.002042 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-6f158b5d-c0c6-4e3c-bf4b-301eb3777f85 tempest-VolumesSnapshotsTestJSON-1086442173 tempest-VolumesSnapshotsTestJSON-1086442173-project] 10.222.0.46 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 1.687019 Aug 04 05:25:08.008338 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 3/4] 10.222.0.46 () {60 vars in 1162 bytes} [Thu Aug 4 05:25:06 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 1693 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:25:08.080746 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-75f9368a-4317-4281-be01-44002820cc5f tempest-VolumesSnapshotsTestJSON-1086442173 tempest-VolumesSnapshotsTestJSON-1086442173-project] Calling method '.version_select at 0x7f14774a9e50>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:25:08.446587 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-75f9368a-4317-4281-be01-44002820cc5f tempest-VolumesSnapshotsTestJSON-1086442173 tempest-VolumesSnapshotsTestJSON-1086442173-project] 10.222.0.46 "GET /compute/v2.1/os-snapshots/5397ba93-28d0-4e87-8db9-fad51e5c80a7" status: 200 len: 287 microversion: 2.1 time: 0.398047 Aug 04 05:25:08.447177 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 2/5] 10.222.0.46 () {58 vars in 1251 bytes} [Thu Aug 4 05:25:08 2022] GET /compute/v2.1/os-snapshots/5397ba93-28d0-4e87-8db9-fad51e5c80a7 => generated 287 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:25:08.458972 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-7c5484d9-f489-4abd-a100-93192a8175cf tempest-VolumesSnapshotsTestJSON-1086442173 tempest-VolumesSnapshotsTestJSON-1086442173-project] Calling method '.version_select at 0x7f14774a98b0>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:25:08.658579 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-a3fbee34-aac8-4db5-98ce-da4335454088 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Action: 'create', calling method: .version_select at 0x7f1477412430>, body: {"keypair": {"name": "tempest-keypair-963919141", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI6Thc6i6q3RPVQG61jeIAIdaPB+6GbLY+GfHn2KlN+i7WmqI+mkGQmkPusFQAKR8dDQfTLQYq++KBFCG40lFAnFscl9X1agcHJpGCHIiD4rjoiKACRAnIkTYR0zCTl9uw=="}} {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:25:08.728108 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.quota [None req-a3fbee34-aac8-4db5-98ce-da4335454088 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Getting quotas for project faead990837d43de8ec54bfaf24361de. Resources: {'key_pairs'} {{(pid=118477) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 05:25:08.743870 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.quota [None req-a3fbee34-aac8-4db5-98ce-da4335454088 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Getting quotas for user 9cb49b631c234f9a9fd47049b9b2e097 and project faead990837d43de8ec54bfaf24361de. Resources: {'key_pairs'} {{(pid=118477) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 05:25:09.181017 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-7c5484d9-f489-4abd-a100-93192a8175cf tempest-VolumesSnapshotsTestJSON-1086442173 tempest-VolumesSnapshotsTestJSON-1086442173-project] 10.222.0.46 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.725896 Aug 04 05:25:09.182044 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 3/6] 10.222.0.46 () {58 vars in 1140 bytes} [Thu Aug 4 05:25:08 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 05:25:09.225662 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-485861ba-a876-4791-9a7b-bf93f46a9094 tempest-VolumesSnapshotsTestJSON-1086442173 tempest-VolumesSnapshotsTestJSON-1086442173-project] Calling method '.version_select at 0x7f14774a9940>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:25:09.264657 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-485861ba-a876-4791-9a7b-bf93f46a9094 tempest-VolumesSnapshotsTestJSON-1086442173 tempest-VolumesSnapshotsTestJSON-1086442173-project] 10.222.0.46 "GET /compute/v2.1/os-snapshots/5397ba93-28d0-4e87-8db9-fad51e5c80a7" status: 200 len: 287 microversion: 2.1 time: 0.067853 Aug 04 05:25:09.270835 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 4/7] 10.222.0.46 () {58 vars in 1251 bytes} [Thu Aug 4 05:25:09 2022] GET /compute/v2.1/os-snapshots/5397ba93-28d0-4e87-8db9-fad51e5c80a7 => generated 287 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 05:25:09.419018 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-a3fbee34-aac8-4db5-98ce-da4335454088 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 1.018083 Aug 04 05:25:09.427276 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 4/8] 10.222.0.46 () {60 vars in 1159 bytes} [Thu Aug 4 05:25:08 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 1020 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:25:10.291734 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-62bddad5-9033-4407-a7c7-1c920ef8ee81 tempest-VolumesSnapshotsTestJSON-1086442173 tempest-VolumesSnapshotsTestJSON-1086442173-project] Calling method '.version_select at 0x7f14773f3790>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:25:10.372208 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-62bddad5-9033-4407-a7c7-1c920ef8ee81 tempest-VolumesSnapshotsTestJSON-1086442173 tempest-VolumesSnapshotsTestJSON-1086442173-project] 10.222.0.46 "GET /compute/v2.1/os-snapshots/5397ba93-28d0-4e87-8db9-fad51e5c80a7" status: 200 len: 287 microversion: 2.1 time: 0.093978 Aug 04 05:25:10.372796 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 5/9] 10.222.0.46 () {58 vars in 1251 bytes} [Thu Aug 4 05:25:10 2022] GET /compute/v2.1/os-snapshots/5397ba93-28d0-4e87-8db9-fad51e5c80a7 => generated 287 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:25:11.392431 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-f18c7ac6-a8a8-4d3c-9284-80b047fd184a tempest-VolumesSnapshotsTestJSON-1086442173 tempest-VolumesSnapshotsTestJSON-1086442173-project] Calling method '.version_select at 0x7f14773e9f70>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:25:11.458111 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-f18c7ac6-a8a8-4d3c-9284-80b047fd184a tempest-VolumesSnapshotsTestJSON-1086442173 tempest-VolumesSnapshotsTestJSON-1086442173-project] 10.222.0.46 "GET /compute/v2.1/os-snapshots/5397ba93-28d0-4e87-8db9-fad51e5c80a7" status: 200 len: 287 microversion: 2.1 time: 0.074490 Aug 04 05:25:11.459806 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 5/10] 10.222.0.46 () {58 vars in 1251 bytes} [Thu Aug 4 05:25:11 2022] GET /compute/v2.1/os-snapshots/5397ba93-28d0-4e87-8db9-fad51e5c80a7 => generated 287 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:25:12.478793 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-f045b305-4218-4de4-9caa-9a736b5beb54 tempest-VolumesSnapshotsTestJSON-1086442173 tempest-VolumesSnapshotsTestJSON-1086442173-project] Calling method '.version_select at 0x7f14773f3310>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:25:12.561400 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-f045b305-4218-4de4-9caa-9a736b5beb54 tempest-VolumesSnapshotsTestJSON-1086442173 tempest-VolumesSnapshotsTestJSON-1086442173-project] 10.222.0.46 "GET /compute/v2.1/os-snapshots/5397ba93-28d0-4e87-8db9-fad51e5c80a7" status: 200 len: 288 microversion: 2.1 time: 0.093891 Aug 04 05:25:12.562219 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 6/11] 10.222.0.46 () {58 vars in 1251 bytes} [Thu Aug 4 05:25:12 2022] GET /compute/v2.1/os-snapshots/5397ba93-28d0-4e87-8db9-fad51e5c80a7 => generated 288 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:25:12.573342 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-48b03c38-5ac1-4031-93f2-2ad4cf6c7d02 tempest-VolumesSnapshotsTestJSON-1086442173 tempest-VolumesSnapshotsTestJSON-1086442173-project] Calling method '.version_select at 0x7f14773a1700>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:25:12.828655 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-48b03c38-5ac1-4031-93f2-2ad4cf6c7d02 tempest-VolumesSnapshotsTestJSON-1086442173 tempest-VolumesSnapshotsTestJSON-1086442173-project] 10.222.0.46 "DELETE /compute/v2.1/os-snapshots/5397ba93-28d0-4e87-8db9-fad51e5c80a7" status: 202 len: 0 microversion: 2.1 time: 0.259037 Aug 04 05:25:12.829626 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 6/12] 10.222.0.46 () {58 vars in 1254 bytes} [Thu Aug 4 05:25:12 2022] DELETE /compute/v2.1/os-snapshots/5397ba93-28d0-4e87-8db9-fad51e5c80a7 => generated 0 bytes in 261 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 05:25:12.840141 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-56327ad2-8247-413f-8a3c-6acfbe1c8ef3 tempest-VolumesSnapshotsTestJSON-1086442173 tempest-VolumesSnapshotsTestJSON-1086442173-project] Calling method '.version_select at 0x7f14773f3160>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:25:13.710451 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-56327ad2-8247-413f-8a3c-6acfbe1c8ef3 tempest-VolumesSnapshotsTestJSON-1086442173 tempest-VolumesSnapshotsTestJSON-1086442173-project] 10.222.0.46 "GET /compute/v2.1/os-snapshots/5397ba93-28d0-4e87-8db9-fad51e5c80a7" status: 200 len: 287 microversion: 2.1 time: 0.876565 Aug 04 05:25:13.711400 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 7/13] 10.222.0.46 () {58 vars in 1251 bytes} [Thu Aug 4 05:25:12 2022] GET /compute/v2.1/os-snapshots/5397ba93-28d0-4e87-8db9-fad51e5c80a7 => generated 287 bytes in 878 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:25:14.315018 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-ad08b588-9bb6-45dd-8f1f-ec78161ad941 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1037108123", "imageRef": "4613f7d0-37ca-46ad-bb26-dc4990dd7d6f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:25:14.442497 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.network.neutron [None req-ad08b588-9bb6-45dd-8f1f-ec78161ad941 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] validate_networks() for [('3d15e8aa-2034-4916-a765-53a0b213f5c6', None, None, None, None, None)] {{(pid=118477) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 05:25:14.724055 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-ea75706e-053d-4841-aee7-0e685f6339d4 tempest-VolumesSnapshotsTestJSON-1086442173 tempest-VolumesSnapshotsTestJSON-1086442173-project] Calling method '.version_select at 0x7f14773f3a60>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:25:14.794597 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-ea75706e-053d-4841-aee7-0e685f6339d4 tempest-VolumesSnapshotsTestJSON-1086442173 tempest-VolumesSnapshotsTestJSON-1086442173-project] 10.222.0.46 "GET /compute/v2.1/os-snapshots/5397ba93-28d0-4e87-8db9-fad51e5c80a7" status: 200 len: 287 microversion: 2.1 time: 0.072677 Aug 04 05:25:14.794597 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 8/14] 10.222.0.46 () {58 vars in 1251 bytes} [Thu Aug 4 05:25:14 2022] GET /compute/v2.1/os-snapshots/5397ba93-28d0-4e87-8db9-fad51e5c80a7 => generated 287 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 05:25:14.917311 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-95531efb-f44e-4cf7-9e57-0ba3268fce09 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-525753813", "imageRef": "4613f7d0-37ca-46ad-bb26-dc4990dd7d6f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "87f9b625-400f-447c-aea1-da3d6773a311"}], "security_groups": [{"name": "tempest-securitygroup--2034864409"}], "key_name": "tempest-keypair-963919141", "user_data": "}} {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:25:15.353003 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.network.neutron [None req-95531efb-f44e-4cf7-9e57-0ba3268fce09 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] validate_networks() for [('87f9b625-400f-447c-aea1-da3d6773a311', None, None, None, None, None)] {{(pid=118476) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 05:25:16.078765 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.virt.hardware [None req-ad08b588-9bb6-45dd-8f1f-ec78161ad941 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Flavor limits 0:0:0 {{(pid=118477) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 05:25:16.079859 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.virt.hardware [None req-ad08b588-9bb6-45dd-8f1f-ec78161ad941 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Image limits 0:0:0 {{(pid=118477) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 05:25:16.080503 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.virt.hardware [None req-ad08b588-9bb6-45dd-8f1f-ec78161ad941 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Flavor pref 0:0:0 {{(pid=118477) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 05:25:16.081073 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.virt.hardware [None req-ad08b588-9bb6-45dd-8f1f-ec78161ad941 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Image pref 0:0:0 {{(pid=118477) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 05:25:16.081656 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.virt.hardware [None req-ad08b588-9bb6-45dd-8f1f-ec78161ad941 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118477) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 05:25:16.097779 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-ad08b588-9bb6-45dd-8f1f-ec78161ad941 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:25:16.098237 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-ad08b588-9bb6-45dd-8f1f-ec78161ad941 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:25:16.099091 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-ad08b588-9bb6-45dd-8f1f-ec78161ad941 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:25:16.099529 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-ad08b588-9bb6-45dd-8f1f-ec78161ad941 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:25:16.145997 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.quota [None req-ad08b588-9bb6-45dd-8f1f-ec78161ad941 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Getting quotas for project b62d19c831574f9b99c993b5e41c645d. Resources: {'instances', 'cores', 'ram'} {{(pid=118477) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 05:25:16.149226 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.quota [None req-ad08b588-9bb6-45dd-8f1f-ec78161ad941 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Getting quotas for user ab8f887f5689419e9e31a0ba43f76ada and project b62d19c831574f9b99c993b5e41c645d. Resources: {'instances', 'cores', 'ram'} {{(pid=118477) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 05:25:16.190513 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-ad08b588-9bb6-45dd-8f1f-ec78161ad941 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Going to run 1 instances... {{(pid=118477) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 05:25:16.193513 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-ad08b588-9bb6-45dd-8f1f-ec78161ad941 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] [instance: b1a612df-55d1-4106-951d-7f0ea95cfe83] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4613f7d0-37ca-46ad-bb26-dc4990dd7d6f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118477) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 05:25:16.487033 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-ad08b588-9bb6-45dd-8f1f-ec78161ad941 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.381918 Aug 04 05:25:16.490385 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 7/15] 10.222.0.46 () {60 vars in 1147 bytes} [Thu Aug 4 05:25:14 2022] POST /compute/v2.1/servers => generated 383 bytes in 2403 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 05:25:16.639060 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-09fab488-9169-45e3-9cc3-8f2b82e24363 tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1803558774", "imageRef": "4613f7d0-37ca-46ad-bb26-dc4990dd7d6f", "flavorRef": "452", "networks": [{"uuid": "227ca56d-a3fd-430e-b0ce-edadf374d5f6"}]}} {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:25:16.738802 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.virt.hardware [None req-95531efb-f44e-4cf7-9e57-0ba3268fce09 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Flavor limits 0:0:0 {{(pid=118476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 05:25:16.739276 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.virt.hardware [None req-95531efb-f44e-4cf7-9e57-0ba3268fce09 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Image limits 0:0:0 {{(pid=118476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 05:25:16.739757 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.virt.hardware [None req-95531efb-f44e-4cf7-9e57-0ba3268fce09 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Flavor pref 0:0:0 {{(pid=118476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 05:25:16.740222 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.virt.hardware [None req-95531efb-f44e-4cf7-9e57-0ba3268fce09 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Image pref 0:0:0 {{(pid=118476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 05:25:16.740638 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.virt.hardware [None req-95531efb-f44e-4cf7-9e57-0ba3268fce09 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 05:25:16.761751 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-95531efb-f44e-4cf7-9e57-0ba3268fce09 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:25:16.762352 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-95531efb-f44e-4cf7-9e57-0ba3268fce09 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:25:16.763326 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-95531efb-f44e-4cf7-9e57-0ba3268fce09 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:25:16.763774 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-95531efb-f44e-4cf7-9e57-0ba3268fce09 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:25:16.789267 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.network.neutron [None req-09fab488-9169-45e3-9cc3-8f2b82e24363 tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] validate_networks() for [('227ca56d-a3fd-430e-b0ce-edadf374d5f6', None, None, None, None, None)] {{(pid=118477) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 05:25:16.850441 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.quota [None req-95531efb-f44e-4cf7-9e57-0ba3268fce09 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Getting quotas for project faead990837d43de8ec54bfaf24361de. Resources: {'instances', 'cores', 'ram'} {{(pid=118476) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 05:25:16.867729 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.quota [None req-95531efb-f44e-4cf7-9e57-0ba3268fce09 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Getting quotas for user 9cb49b631c234f9a9fd47049b9b2e097 and project faead990837d43de8ec54bfaf24361de. Resources: {'instances', 'cores', 'ram'} {{(pid=118476) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 05:25:16.897985 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-95531efb-f44e-4cf7-9e57-0ba3268fce09 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Going to run 1 instances... {{(pid=118476) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 05:25:16.908272 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-95531efb-f44e-4cf7-9e57-0ba3268fce09 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] [instance: 384721d7-1467-45cd-af93-eb458115f75e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4613f7d0-37ca-46ad-bb26-dc4990dd7d6f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118476) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 05:25:17.160702 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-95531efb-f44e-4cf7-9e57-0ba3268fce09 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.250621 Aug 04 05:25:17.173500 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 9/16] 10.222.0.46 () {60 vars in 1147 bytes} [Thu Aug 4 05:25:14 2022] POST /compute/v2.1/servers => generated 402 bytes in 2266 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 05:25:17.185228 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-c8fd31fb-4eb5-473c-bac8-67f4e29527ec tempest-VolumesSnapshotsTestJSON-1086442173 tempest-VolumesSnapshotsTestJSON-1086442173-project] Calling method '.version_select at 0x7f1476b250d0>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:25:17.557099 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.virt.hardware [None req-09fab488-9169-45e3-9cc3-8f2b82e24363 tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] Flavor limits 0:0:0 {{(pid=118477) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 05:25:17.558576 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.virt.hardware [None req-09fab488-9169-45e3-9cc3-8f2b82e24363 tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] Image limits 0:0:0 {{(pid=118477) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 05:25:17.558576 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.virt.hardware [None req-09fab488-9169-45e3-9cc3-8f2b82e24363 tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] Flavor pref 0:0:0 {{(pid=118477) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 05:25:17.559448 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.virt.hardware [None req-09fab488-9169-45e3-9cc3-8f2b82e24363 tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] Image pref 0:0:0 {{(pid=118477) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 05:25:17.559448 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.virt.hardware [None req-09fab488-9169-45e3-9cc3-8f2b82e24363 tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118477) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 05:25:17.576331 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-09fab488-9169-45e3-9cc3-8f2b82e24363 tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:25:17.577110 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-09fab488-9169-45e3-9cc3-8f2b82e24363 tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:25:17.578854 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-09fab488-9169-45e3-9cc3-8f2b82e24363 tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:25:17.579545 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-09fab488-9169-45e3-9cc3-8f2b82e24363 tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:25:17.608159 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.quota [None req-09fab488-9169-45e3-9cc3-8f2b82e24363 tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] Getting quotas for project bd41986c224f414b8768675f40682380. Resources: {'instances', 'cores', 'ram'} {{(pid=118477) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 05:25:17.613976 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.quota [None req-09fab488-9169-45e3-9cc3-8f2b82e24363 tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] Getting quotas for user e916e4e0fb7140b0912e9233898a0016 and project bd41986c224f414b8768675f40682380. Resources: {'instances', 'cores', 'ram'} {{(pid=118477) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 05:25:17.634946 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-09fab488-9169-45e3-9cc3-8f2b82e24363 tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] Going to run 1 instances... {{(pid=118477) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 05:25:17.638422 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-09fab488-9169-45e3-9cc3-8f2b82e24363 tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] [instance: 5ad11a1d-cf86-446c-9e0a-db8e16d3fbeb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4613f7d0-37ca-46ad-bb26-dc4990dd7d6f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118477) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 05:25:17.932258 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-09fab488-9169-45e3-9cc3-8f2b82e24363 tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.440306 Aug 04 05:25:17.933505 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 8/17] 10.222.0.46 () {60 vars in 1147 bytes} [Thu Aug 4 05:25:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 1443 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 05:25:17.973736 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-4829e44d-eaa8-471e-a5d4-8c60395444bc tempest-VolumesTestJSON-286556406 tempest-VolumesTestJSON-286556406-project] Calling method '.version_select at 0x7f1476ad9940>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:25:18.027628 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.wsgi [None req-c8fd31fb-4eb5-473c-bac8-67f4e29527ec tempest-VolumesSnapshotsTestJSON-1086442173 tempest-VolumesSnapshotsTestJSON-1086442173-project] HTTP exception thrown: Snapshot 5397ba93-28d0-4e87-8db9-fad51e5c80a7 could not be found. Aug 04 05:25:18.032211 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-c8fd31fb-4eb5-473c-bac8-67f4e29527ec tempest-VolumesSnapshotsTestJSON-1086442173 tempest-VolumesSnapshotsTestJSON-1086442173-project] Request method failure captured: Aug 04 05:25:18.032211 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: request: GET /compute/v2.1/os-snapshots/5397ba93-28d0-4e87-8db9-fad51e5c80a7 HTTP/1.1 Aug 04 05:25:18.032211 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: Accept: application/json Aug 04 05:25:18.032211 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: Accept-Encoding: identity Aug 04 05:25:18.032211 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: Connection: close Aug 04 05:25:18.032211 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: Content-Length: 0 Aug 04 05:25:18.032211 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: Content-Type: application/json Aug 04 05:25:18.032211 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: Host: 10.222.0.46 Aug 04 05:25:18.032211 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: Openstack-System-Scope: None Aug 04 05:25:18.032211 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: User-Agent: python-urllib3/1.26.11 Aug 04 05:25:18.032211 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Auth-Token: gAAAAABi61gra1-LdpMFeUMdkPUm9yk3r1mpvVR7OzVXf3d0AfHd1wPPu4AKXtx-2NiKQx3sFDOp2vH0yMgGYr3j674aM48an0mszqbEqzv1vFmqr6MsdOdGjtUIgmsJlIdzXXbIRWxrJlMBX98dUsaN1r5_oy1oXHv84AfXRUHa1w-XT6w3ctU Aug 04 05:25:18.032211 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Domain-Id: None Aug 04 05:25:18.032211 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Domain-Name: None Aug 04 05:25:18.032211 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Identity-Status: Confirmed Aug 04 05:25:18.032211 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Is-Admin-Project: True Aug 04 05:25:18.032211 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Project-Domain-Id: default Aug 04 05:25:18.032211 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Project-Domain-Name: Default Aug 04 05:25:18.032211 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Project-Id: 820b25adb06d4245b9782065161f70b3 Aug 04 05:25:18.032211 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1086442173 Aug 04 05:25:18.032211 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Role: member,reader Aug 04 05:25:18.032211 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Roles: member,reader Aug 04 05:25:18.033872 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/820b25adb06d4245b9782065161f70b3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/820b25adb06d4245b9782065161f70b3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_820b25adb06d4245b9782065161f70b3", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/820b25adb06d4245b9782065161f70b3"}]}] Aug 04 05:25:18.033872 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1086442173 Aug 04 05:25:18.033872 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Tenant-Id: 820b25adb06d4245b9782065161f70b3 Aug 04 05:25:18.033872 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1086442173 Aug 04 05:25:18.033872 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-User: tempest-VolumesSnapshotsTestJSON-1086442173-project Aug 04 05:25:18.033872 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-User-Domain-Id: default Aug 04 05:25:18.033872 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-User-Domain-Name: Default Aug 04 05:25:18.033872 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-User-Id: a4c17d030bc245a18605be1d10f12419 Aug 04 05:25:18.033872 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1086442173-project Aug 04 05:25:18.033872 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: method: Aug 04 05:25:18.033872 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: exception: Snapshot 5397ba93-28d0-4e87-8db9-fad51e5c80a7 could not be found. Aug 04 05:25:18.033872 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: action_args: {'id': '5397ba93-28d0-4e87-8db9-fad51e5c80a7'} Aug 04 05:25:18.033872 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 05:25:18.035145 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:25:18.035145 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 04 05:25:18.035145 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 04 05:25:18.035145 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 04 05:25:18.035145 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 04 05:25:18.035145 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 04 05:25:18.035145 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 04 05:25:18.035145 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 04 05:25:18.035145 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 04 05:25:18.035145 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 04 05:25:18.035145 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 04 05:25:18.035145 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 04 05:25:18.035145 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 04 05:25:18.035145 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 04 05:25:18.035145 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 04 05:25:18.035145 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 5397ba93-28d0-4e87-8db9-fad51e5c80a7 could not be found. (HTTP 404) (Request-ID: req-08686ca8-3ce6-4344-bba7-c338252261f3) Aug 04 05:25:18.035145 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Aug 04 05:25:18.035145 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:25:18.036847 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Aug 04 05:25:18.036847 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:25:18.036847 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Aug 04 05:25:18.036847 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Aug 04 05:25:18.036847 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 04 05:25:18.036847 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 04 05:25:18.036847 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Aug 04 05:25:18.036847 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Aug 04 05:25:18.036847 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 04 05:25:18.036847 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 04 05:25:18.036847 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 04 05:25:18.036847 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 04 05:25:18.036847 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 04 05:25:18.036847 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 04 05:25:18.036847 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 04 05:25:18.036847 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 04 05:25:18.036847 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 04 05:25:18.036847 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 04 05:25:18.036847 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 04 05:25:18.038385 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 04 05:25:18.038385 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 04 05:25:18.038385 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 04 05:25:18.038385 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 04 05:25:18.038385 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 04 05:25:18.038385 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 5397ba93-28d0-4e87-8db9-fad51e5c80a7 could not be found. Aug 04 05:25:18.038385 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Aug 04 05:25:18.038385 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:25:18.038385 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Aug 04 05:25:18.038385 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:25:18.038385 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:25:18.038385 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:25:18.038385 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 05:25:18.038385 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 05:25:18.038385 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 05:25:18.038385 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 05:25:18.038385 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 05:25:18.038385 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 05:25:18.038385 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Aug 04 05:25:18.038385 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 05:25:18.039647 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 5397ba93-28d0-4e87-8db9-fad51e5c80a7 could not be found. Aug 04 05:25:18.039647 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Aug 04 05:25:18.039647 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:25:18.039647 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Aug 04 05:25:18.039647 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:25:18.039647 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:25:18.039647 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:25:18.039647 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 05:25:18.039647 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 05:25:18.039647 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 5397ba93-28d0-4e87-8db9-fad51e5c80a7 could not be found. Aug 04 05:25:18.039647 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Aug 04 05:25:18.049962 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-c8fd31fb-4eb5-473c-bac8-67f4e29527ec tempest-VolumesSnapshotsTestJSON-1086442173 tempest-VolumesSnapshotsTestJSON-1086442173-project] Returning 404 to user: Snapshot 5397ba93-28d0-4e87-8db9-fad51e5c80a7 could not be found. {{(pid=118476) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 05:25:18.051279 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-c8fd31fb-4eb5-473c-bac8-67f4e29527ec tempest-VolumesSnapshotsTestJSON-1086442173 tempest-VolumesSnapshotsTestJSON-1086442173-project] 10.222.0.46 "GET /compute/v2.1/os-snapshots/5397ba93-28d0-4e87-8db9-fad51e5c80a7" status: 404 len: 111 microversion: 2.1 time: 0.876278 Aug 04 05:25:18.054022 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 10/18] 10.222.0.46 () {58 vars in 1251 bytes} [Thu Aug 4 05:25:17 2022] GET /compute/v2.1/os-snapshots/5397ba93-28d0-4e87-8db9-fad51e5c80a7 => generated 111 bytes in 880 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 05:25:18.081458 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-94560c17-7eb6-478f-b8bd-970ab963b527 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:25:18.082496 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-94560c17-7eb6-478f-b8bd-970ab963b527 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] [instance: b1a612df-55d1-4106-951d-7f0ea95cfe83] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:25:18.283066 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-4829e44d-eaa8-471e-a5d4-8c60395444bc tempest-VolumesTestJSON-286556406 tempest-VolumesTestJSON-286556406-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/c40175d5-7010-42c4-a82d-a7b846750a2c" status: 200 len: 351 microversion: 2.1 time: 0.331867 Aug 04 05:25:18.283841 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 9/19] 10.222.0.46 () {58 vars in 1245 bytes} [Thu Aug 4 05:25:17 2022] GET /compute/v2.1/os-volumes/c40175d5-7010-42c4-a82d-a7b846750a2c => generated 351 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:25:18.289761 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-99144653-4ddc-4b8b-b9fd-26f44607b1ef tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:25:18.290802 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-99144653-4ddc-4b8b-b9fd-26f44607b1ef tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] [instance: 384721d7-1467-45cd-af93-eb458115f75e] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:25:18.342452 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-94560c17-7eb6-478f-b8bd-970ab963b527 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8f887f5689419e9e31a0ba43f76ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62d19c831574f9b99c993b5e41c645d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:25:18.382814 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-94560c17-7eb6-478f-b8bd-970ab963b527 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] 10.222.0.46 "GET /compute/v2.1/servers/b1a612df-55d1-4106-951d-7f0ea95cfe83" status: 200 len: 1222 microversion: 2.1 time: 0.323832 Aug 04 05:25:18.383398 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 11/20] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:25:18 2022] GET /compute/v2.1/servers/b1a612df-55d1-4106-951d-7f0ea95cfe83 => generated 1222 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:25:18.411403 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-a1197b0e-bfd4-41b7-bf27-2a48b884b122 tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:25:18.412058 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-a1197b0e-bfd4-41b7-bf27-2a48b884b122 tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] [instance: 5ad11a1d-cf86-446c-9e0a-db8e16d3fbeb] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:25:18.530447 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-99144653-4ddc-4b8b-b9fd-26f44607b1ef tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb49b631c234f9a9fd47049b9b2e097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faead990837d43de8ec54bfaf24361de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:25:18.558400 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-99144653-4ddc-4b8b-b9fd-26f44607b1ef tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] 10.222.0.46 "GET /compute/v2.1/servers/384721d7-1467-45cd-af93-eb458115f75e" status: 200 len: 1240 microversion: 2.1 time: 0.272943 Aug 04 05:25:18.563619 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 10/21] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:25:18 2022] GET /compute/v2.1/servers/384721d7-1467-45cd-af93-eb458115f75e => generated 1240 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:25:18.579536 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-f9e7221e-4274-4210-b12f-f375563d6efe tempest-VolumesSnapshotsTestJSON-1086442173 tempest-VolumesSnapshotsTestJSON-1086442173-project] Calling method '.version_select at 0x7f1476aed5e0>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:25:18.622287 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-a1197b0e-bfd4-41b7-bf27-2a48b884b122 tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e916e4e0fb7140b0912e9233898a0016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd41986c224f414b8768675f40682380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:25:18.645712 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-a1197b0e-bfd4-41b7-bf27-2a48b884b122 tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] 10.222.0.46 "GET /compute/v2.1/servers/5ad11a1d-cf86-446c-9e0a-db8e16d3fbeb" status: 200 len: 1215 microversion: 2.1 time: 0.250432 Aug 04 05:25:18.665900 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 12/22] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:25:18 2022] GET /compute/v2.1/servers/5ad11a1d-cf86-446c-9e0a-db8e16d3fbeb => generated 1215 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:25:18.676377 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-35b474c8-986d-4fd7-bcf5-9d5995731254 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1239068234", "imageRef": "4613f7d0-37ca-46ad-bb26-dc4990dd7d6f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:25:18.813900 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.network.neutron [None req-35b474c8-986d-4fd7-bcf5-9d5995731254 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] validate_networks() for [('3d15e8aa-2034-4916-a765-53a0b213f5c6', None, None, None, None, None)] {{(pid=118476) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 05:25:19.498820 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.virt.hardware [None req-35b474c8-986d-4fd7-bcf5-9d5995731254 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Flavor limits 0:0:0 {{(pid=118476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 05:25:19.500251 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.virt.hardware [None req-35b474c8-986d-4fd7-bcf5-9d5995731254 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Image limits 0:0:0 {{(pid=118476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 05:25:19.500932 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.virt.hardware [None req-35b474c8-986d-4fd7-bcf5-9d5995731254 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Flavor pref 0:0:0 {{(pid=118476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 05:25:19.501572 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.virt.hardware [None req-35b474c8-986d-4fd7-bcf5-9d5995731254 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Image pref 0:0:0 {{(pid=118476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 05:25:19.502239 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.virt.hardware [None req-35b474c8-986d-4fd7-bcf5-9d5995731254 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 05:25:19.513890 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-35b474c8-986d-4fd7-bcf5-9d5995731254 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:25:19.514415 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-35b474c8-986d-4fd7-bcf5-9d5995731254 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:25:19.515478 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-35b474c8-986d-4fd7-bcf5-9d5995731254 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:25:19.515927 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-35b474c8-986d-4fd7-bcf5-9d5995731254 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:25:19.535195 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.quota [None req-35b474c8-986d-4fd7-bcf5-9d5995731254 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Getting quotas for project b62d19c831574f9b99c993b5e41c645d. Resources: {'instances', 'cores', 'ram'} {{(pid=118476) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 05:25:19.540006 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.quota [None req-35b474c8-986d-4fd7-bcf5-9d5995731254 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Getting quotas for user ab8f887f5689419e9e31a0ba43f76ada and project b62d19c831574f9b99c993b5e41c645d. Resources: {'instances', 'cores', 'ram'} {{(pid=118476) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 05:25:19.559447 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-35b474c8-986d-4fd7-bcf5-9d5995731254 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Going to run 1 instances... {{(pid=118476) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 05:25:19.563810 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-35b474c8-986d-4fd7-bcf5-9d5995731254 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] [instance: 98f543b7-5432-4a4a-9494-63dac0f733b7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4613f7d0-37ca-46ad-bb26-dc4990dd7d6f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118476) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 05:25:19.597943 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-f9e7221e-4274-4210-b12f-f375563d6efe tempest-VolumesSnapshotsTestJSON-1086442173 tempest-VolumesSnapshotsTestJSON-1086442173-project] 10.222.0.46 "DELETE /compute/v2.1/os-volumes/9696a9eb-21e7-4153-b7e2-99e4abbae478" status: 202 len: 0 microversion: 2.1 time: 1.032587 Aug 04 05:25:19.598656 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 11/23] 10.222.0.46 () {58 vars in 1248 bytes} [Thu Aug 4 05:25:18 2022] DELETE /compute/v2.1/os-volumes/9696a9eb-21e7-4153-b7e2-99e4abbae478 => generated 0 bytes in 1034 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 05:25:19.603942 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-8c26cab8-60b1-47d1-950f-f5b5c041a56a tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:25:19.605563 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-8c26cab8-60b1-47d1-950f-f5b5c041a56a tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] [instance: 384721d7-1467-45cd-af93-eb458115f75e] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:25:19.724916 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-8c26cab8-60b1-47d1-950f-f5b5c041a56a tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb49b631c234f9a9fd47049b9b2e097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faead990837d43de8ec54bfaf24361de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:25:19.735778 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-8c26cab8-60b1-47d1-950f-f5b5c041a56a tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] 10.222.0.46 "GET /compute/v2.1/servers/384721d7-1467-45cd-af93-eb458115f75e" status: 200 len: 1240 microversion: 2.1 time: 0.135773 Aug 04 05:25:19.753256 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 12/24] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:25:19 2022] GET /compute/v2.1/servers/384721d7-1467-45cd-af93-eb458115f75e => generated 1240 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:25:19.764782 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-23e82510-d1c7-40ff-a42d-b4b5f9e16fd2 tempest-VolumesSnapshotsTestJSON-1086442173 tempest-VolumesSnapshotsTestJSON-1086442173-project] Calling method '.version_select at 0x7f1475a7a820>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:25:19.801054 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-35b474c8-986d-4fd7-bcf5-9d5995731254 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.131563 Aug 04 05:25:19.803642 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 13/25] 10.222.0.46 () {60 vars in 1147 bytes} [Thu Aug 4 05:25:18 2022] POST /compute/v2.1/servers => generated 383 bytes in 1137 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 05:25:19.808812 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-6323a3ec-fb3d-4b66-af31-677943e8ac9b tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:25:19.818907 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-6323a3ec-fb3d-4b66-af31-677943e8ac9b tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] [instance: 5ad11a1d-cf86-446c-9e0a-db8e16d3fbeb] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:25:19.958117 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-6323a3ec-fb3d-4b66-af31-677943e8ac9b tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e916e4e0fb7140b0912e9233898a0016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd41986c224f414b8768675f40682380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:25:19.975982 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-6323a3ec-fb3d-4b66-af31-677943e8ac9b tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] 10.222.0.46 "GET /compute/v2.1/servers/5ad11a1d-cf86-446c-9e0a-db8e16d3fbeb" status: 200 len: 1215 microversion: 2.1 time: 0.167220 Aug 04 05:25:19.998995 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 14/26] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:25:19 2022] GET /compute/v2.1/servers/5ad11a1d-cf86-446c-9e0a-db8e16d3fbeb => generated 1215 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:25:20.024814 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-23e82510-d1c7-40ff-a42d-b4b5f9e16fd2 tempest-VolumesSnapshotsTestJSON-1086442173 tempest-VolumesSnapshotsTestJSON-1086442173-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/9696a9eb-21e7-4153-b7e2-99e4abbae478" status: 200 len: 344 microversion: 2.1 time: 0.272286 Aug 04 05:25:20.027770 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 13/27] 10.222.0.46 () {58 vars in 1245 bytes} [Thu Aug 4 05:25:19 2022] GET /compute/v2.1/os-volumes/9696a9eb-21e7-4153-b7e2-99e4abbae478 => generated 344 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:25:20.045711 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-84545aae-15a5-4aa4-89e1-afe728e6be24 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:25:20.049297 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-84545aae-15a5-4aa4-89e1-afe728e6be24 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] [instance: 98f543b7-5432-4a4a-9494-63dac0f733b7] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:25:20.154846 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-84545aae-15a5-4aa4-89e1-afe728e6be24 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8f887f5689419e9e31a0ba43f76ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62d19c831574f9b99c993b5e41c645d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:25:20.164879 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-84545aae-15a5-4aa4-89e1-afe728e6be24 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] 10.222.0.46 "GET /compute/v2.1/servers/98f543b7-5432-4a4a-9494-63dac0f733b7" status: 200 len: 1222 microversion: 2.1 time: 0.164315 Aug 04 05:25:20.165464 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 15/28] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:25:19 2022] GET /compute/v2.1/servers/98f543b7-5432-4a4a-9494-63dac0f733b7 => generated 1222 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:25:20.761463 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-92a3ae07-56d7-4918-a400-b33ddee5e81c tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:25:20.762122 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-92a3ae07-56d7-4918-a400-b33ddee5e81c tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] [instance: 384721d7-1467-45cd-af93-eb458115f75e] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:25:20.768750 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-92a3ae07-56d7-4918-a400-b33ddee5e81c tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:25:20.769200 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-92a3ae07-56d7-4918-a400-b33ddee5e81c tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:25:20.769979 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-92a3ae07-56d7-4918-a400-b33ddee5e81c tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:25:20.770455 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-92a3ae07-56d7-4918-a400-b33ddee5e81c tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:25:20.935678 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-92a3ae07-56d7-4918-a400-b33ddee5e81c tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb49b631c234f9a9fd47049b9b2e097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faead990837d43de8ec54bfaf24361de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:25:20.948080 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-92a3ae07-56d7-4918-a400-b33ddee5e81c tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] 10.222.0.46 "GET /compute/v2.1/servers/384721d7-1467-45cd-af93-eb458115f75e" status: 200 len: 1244 microversion: 2.1 time: 0.191144 Aug 04 05:25:20.950071 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 14/29] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:25:20 2022] GET /compute/v2.1/servers/384721d7-1467-45cd-af93-eb458115f75e => generated 1244 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:25:21.016739 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-b7af458d-612e-47f3-aaf1-17201a0a6f46 tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:25:21.017768 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-b7af458d-612e-47f3-aaf1-17201a0a6f46 tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] [instance: 5ad11a1d-cf86-446c-9e0a-db8e16d3fbeb] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:25:21.026984 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-b7af458d-612e-47f3-aaf1-17201a0a6f46 tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:25:21.031158 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-b7af458d-612e-47f3-aaf1-17201a0a6f46 tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:25:21.031158 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-b7af458d-612e-47f3-aaf1-17201a0a6f46 tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:25:21.031158 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-b7af458d-612e-47f3-aaf1-17201a0a6f46 tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:25:21.040911 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-66d68c80-06dc-4a92-9513-ac8d1aa99210 tempest-VolumesSnapshotsTestJSON-1086442173 tempest-VolumesSnapshotsTestJSON-1086442173-project] Calling method '.version_select at 0x7f1475a639d0>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:25:21.104366 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-66d68c80-06dc-4a92-9513-ac8d1aa99210 tempest-VolumesSnapshotsTestJSON-1086442173 tempest-VolumesSnapshotsTestJSON-1086442173-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/9696a9eb-21e7-4153-b7e2-99e4abbae478" status: 200 len: 344 microversion: 2.1 time: 0.065955 Aug 04 05:25:21.104366 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 15/30] 10.222.0.46 () {58 vars in 1245 bytes} [Thu Aug 4 05:25:21 2022] GET /compute/v2.1/os-volumes/9696a9eb-21e7-4153-b7e2-99e4abbae478 => generated 344 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 05:25:21.185644 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-b7af458d-612e-47f3-aaf1-17201a0a6f46 tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e916e4e0fb7140b0912e9233898a0016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd41986c224f414b8768675f40682380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:25:21.192643 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-465b7e78-f204-470c-96ef-c42627ddd008 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:25:21.193264 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-465b7e78-f204-470c-96ef-c42627ddd008 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] [instance: 98f543b7-5432-4a4a-9494-63dac0f733b7] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:25:21.198261 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-b7af458d-612e-47f3-aaf1-17201a0a6f46 tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] 10.222.0.46 "GET /compute/v2.1/servers/5ad11a1d-cf86-446c-9e0a-db8e16d3fbeb" status: 200 len: 1219 microversion: 2.1 time: 0.187884 Aug 04 05:25:21.198902 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 16/31] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:25:21 2022] GET /compute/v2.1/servers/5ad11a1d-cf86-446c-9e0a-db8e16d3fbeb => generated 1219 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:25:21.207316 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-465b7e78-f204-470c-96ef-c42627ddd008 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:25:21.207316 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-465b7e78-f204-470c-96ef-c42627ddd008 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:25:21.207316 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-465b7e78-f204-470c-96ef-c42627ddd008 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:25:21.207316 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-465b7e78-f204-470c-96ef-c42627ddd008 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:25:21.282221 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-465b7e78-f204-470c-96ef-c42627ddd008 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8f887f5689419e9e31a0ba43f76ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62d19c831574f9b99c993b5e41c645d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:25:21.295405 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-465b7e78-f204-470c-96ef-c42627ddd008 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] 10.222.0.46 "GET /compute/v2.1/servers/98f543b7-5432-4a4a-9494-63dac0f733b7" status: 200 len: 1226 microversion: 2.1 time: 0.106458 Aug 04 05:25:21.296052 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 16/32] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:25:21 2022] GET /compute/v2.1/servers/98f543b7-5432-4a4a-9494-63dac0f733b7 => generated 1226 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 05:25:21.977894 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-3edbd383-b68d-4f3d-af9f-5b6e842546ab tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:25:21.978823 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-3edbd383-b68d-4f3d-af9f-5b6e842546ab tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] [instance: 384721d7-1467-45cd-af93-eb458115f75e] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:25:21.985566 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-3edbd383-b68d-4f3d-af9f-5b6e842546ab tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:25:21.990257 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-3edbd383-b68d-4f3d-af9f-5b6e842546ab tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:25:21.993526 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-3edbd383-b68d-4f3d-af9f-5b6e842546ab tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:25:21.994253 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-3edbd383-b68d-4f3d-af9f-5b6e842546ab tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:25:22.070035 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-3edbd383-b68d-4f3d-af9f-5b6e842546ab tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb49b631c234f9a9fd47049b9b2e097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faead990837d43de8ec54bfaf24361de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:25:22.080261 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-3edbd383-b68d-4f3d-af9f-5b6e842546ab tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] 10.222.0.46 "GET /compute/v2.1/servers/384721d7-1467-45cd-af93-eb458115f75e" status: 200 len: 1236 microversion: 2.1 time: 0.106570 Aug 04 05:25:22.080893 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 17/33] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:25:21 2022] GET /compute/v2.1/servers/384721d7-1467-45cd-af93-eb458115f75e => generated 1236 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:25:22.121187 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-7d68da92-2886-416b-a178-3818d7c07f37 tempest-VolumesSnapshotsTestJSON-1086442173 tempest-VolumesSnapshotsTestJSON-1086442173-project] Calling method '.version_select at 0x7f14759f3700>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:25:22.174999 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-7d68da92-2886-416b-a178-3818d7c07f37 tempest-VolumesSnapshotsTestJSON-1086442173 tempest-VolumesSnapshotsTestJSON-1086442173-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/9696a9eb-21e7-4153-b7e2-99e4abbae478" status: 200 len: 344 microversion: 2.1 time: 0.056687 Aug 04 05:25:22.174999 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 17/34] 10.222.0.46 () {58 vars in 1245 bytes} [Thu Aug 4 05:25:22 2022] GET /compute/v2.1/os-volumes/9696a9eb-21e7-4153-b7e2-99e4abbae478 => generated 344 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:25:22.228680 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-717b348e-e4fb-4cf8-8e33-2543a8628eb4 tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:25:22.229450 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-717b348e-e4fb-4cf8-8e33-2543a8628eb4 tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] [instance: 5ad11a1d-cf86-446c-9e0a-db8e16d3fbeb] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:25:22.235762 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-717b348e-e4fb-4cf8-8e33-2543a8628eb4 tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:25:22.236209 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-717b348e-e4fb-4cf8-8e33-2543a8628eb4 tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:25:22.237104 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-717b348e-e4fb-4cf8-8e33-2543a8628eb4 tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:25:22.237506 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-717b348e-e4fb-4cf8-8e33-2543a8628eb4 tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:25:22.319166 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-6e910272-4f12-436f-b79e-b599538649ca tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:25:22.319730 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-6e910272-4f12-436f-b79e-b599538649ca tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] [instance: 98f543b7-5432-4a4a-9494-63dac0f733b7] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:25:22.325926 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-717b348e-e4fb-4cf8-8e33-2543a8628eb4 tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e916e4e0fb7140b0912e9233898a0016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd41986c224f414b8768675f40682380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:25:22.327344 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-6e910272-4f12-436f-b79e-b599538649ca tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:25:22.327799 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-6e910272-4f12-436f-b79e-b599538649ca tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:25:22.328935 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-6e910272-4f12-436f-b79e-b599538649ca tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:25:22.330080 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-6e910272-4f12-436f-b79e-b599538649ca tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:25:22.333853 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-717b348e-e4fb-4cf8-8e33-2543a8628eb4 tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] 10.222.0.46 "GET /compute/v2.1/servers/5ad11a1d-cf86-446c-9e0a-db8e16d3fbeb" status: 200 len: 1267 microversion: 2.1 time: 0.109268 Aug 04 05:25:22.334459 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 18/35] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:25:22 2022] GET /compute/v2.1/servers/5ad11a1d-cf86-446c-9e0a-db8e16d3fbeb => generated 1267 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:25:22.399945 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-6e910272-4f12-436f-b79e-b599538649ca tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8f887f5689419e9e31a0ba43f76ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62d19c831574f9b99c993b5e41c645d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:25:22.409046 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-6e910272-4f12-436f-b79e-b599538649ca tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] 10.222.0.46 "GET /compute/v2.1/servers/98f543b7-5432-4a4a-9494-63dac0f733b7" status: 200 len: 1218 microversion: 2.1 time: 0.094910 Aug 04 05:25:22.410832 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 18/36] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:25:22 2022] GET /compute/v2.1/servers/98f543b7-5432-4a4a-9494-63dac0f733b7 => generated 1218 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:25:23.089428 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-dc22e759-694a-4ea6-9528-806c361119a0 tempest-VolumesTestJSON-286556406 tempest-VolumesTestJSON-286556406-project] Calling method '.version_select at 0x7f1476226ee0>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:25:23.103810 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-23d1e378-c9b5-46fb-a633-83c05a5f1772 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:25:23.105316 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-23d1e378-c9b5-46fb-a633-83c05a5f1772 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] [instance: 384721d7-1467-45cd-af93-eb458115f75e] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:25:23.119938 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-23d1e378-c9b5-46fb-a633-83c05a5f1772 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:25:23.120216 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-23d1e378-c9b5-46fb-a633-83c05a5f1772 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:25:23.121673 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-23d1e378-c9b5-46fb-a633-83c05a5f1772 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:25:23.134573 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-23d1e378-c9b5-46fb-a633-83c05a5f1772 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:25:23.161759 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-dc22e759-694a-4ea6-9528-806c361119a0 tempest-VolumesTestJSON-286556406 tempest-VolumesTestJSON-286556406-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/1e084884-3be3-4160-9f42-f65c3913e7d2" status: 200 len: 350 microversion: 2.1 time: 0.076756 Aug 04 05:25:23.184139 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 19/37] 10.222.0.46 () {58 vars in 1245 bytes} [Thu Aug 4 05:25:23 2022] GET /compute/v2.1/os-volumes/1e084884-3be3-4160-9f42-f65c3913e7d2 => generated 350 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 05:25:23.191351 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-18b5c4e9-6fca-4eb9-827b-827b2c16ba98 tempest-VolumesTestJSON-286556406 tempest-VolumesTestJSON-286556406-project] Calling method '.version_select at 0x7f1476232ca0>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:25:23.309831 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-23d1e378-c9b5-46fb-a633-83c05a5f1772 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb49b631c234f9a9fd47049b9b2e097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faead990837d43de8ec54bfaf24361de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:25:23.322433 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-23d1e378-c9b5-46fb-a633-83c05a5f1772 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] 10.222.0.46 "GET /compute/v2.1/servers/384721d7-1467-45cd-af93-eb458115f75e" status: 200 len: 1292 microversion: 2.1 time: 0.223152 Aug 04 05:25:23.336655 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 19/38] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:25:23 2022] GET /compute/v2.1/servers/384721d7-1467-45cd-af93-eb458115f75e => generated 1292 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 05:25:23.343708 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-b493ab21-d78c-4b08-9f76-d59a9f6dd24f tempest-VolumesSnapshotsTestJSON-1086442173 tempest-VolumesSnapshotsTestJSON-1086442173-project] Calling method '.version_select at 0x7f14759f38b0>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:25:23.360353 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-18b5c4e9-6fca-4eb9-827b-827b2c16ba98 tempest-VolumesTestJSON-286556406 tempest-VolumesTestJSON-286556406-project] 10.222.0.46 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.174994 Aug 04 05:25:23.361019 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 20/39] 10.222.0.46 () {58 vars in 1134 bytes} [Thu Aug 4 05:25:23 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:25:23.376069 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-9673d615-fbbf-4c97-b035-cbbeda120c1f tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:25:23.376775 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-9673d615-fbbf-4c97-b035-cbbeda120c1f tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] [instance: 5ad11a1d-cf86-446c-9e0a-db8e16d3fbeb] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:25:23.381558 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.wsgi [None req-b493ab21-d78c-4b08-9f76-d59a9f6dd24f tempest-VolumesSnapshotsTestJSON-1086442173 tempest-VolumesSnapshotsTestJSON-1086442173-project] HTTP exception thrown: Volume 9696a9eb-21e7-4153-b7e2-99e4abbae478 could not be found. Aug 04 05:25:23.383196 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-9673d615-fbbf-4c97-b035-cbbeda120c1f tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:25:23.383735 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-9673d615-fbbf-4c97-b035-cbbeda120c1f tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:25:23.384647 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-9673d615-fbbf-4c97-b035-cbbeda120c1f tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:25:23.385093 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-9673d615-fbbf-4c97-b035-cbbeda120c1f tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:25:23.386485 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-b493ab21-d78c-4b08-9f76-d59a9f6dd24f tempest-VolumesSnapshotsTestJSON-1086442173 tempest-VolumesSnapshotsTestJSON-1086442173-project] Request method failure captured: Aug 04 05:25:23.386485 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: request: GET /compute/v2.1/os-volumes/9696a9eb-21e7-4153-b7e2-99e4abbae478 HTTP/1.1 Aug 04 05:25:23.386485 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: Accept: application/json Aug 04 05:25:23.386485 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: Accept-Encoding: identity Aug 04 05:25:23.386485 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: Connection: close Aug 04 05:25:23.386485 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: Content-Length: 0 Aug 04 05:25:23.386485 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: Content-Type: application/json Aug 04 05:25:23.386485 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: Host: 10.222.0.46 Aug 04 05:25:23.386485 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: Openstack-System-Scope: None Aug 04 05:25:23.386485 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: User-Agent: python-urllib3/1.26.11 Aug 04 05:25:23.386485 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Auth-Token: gAAAAABi61gra1-LdpMFeUMdkPUm9yk3r1mpvVR7OzVXf3d0AfHd1wPPu4AKXtx-2NiKQx3sFDOp2vH0yMgGYr3j674aM48an0mszqbEqzv1vFmqr6MsdOdGjtUIgmsJlIdzXXbIRWxrJlMBX98dUsaN1r5_oy1oXHv84AfXRUHa1w-XT6w3ctU Aug 04 05:25:23.386485 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Domain-Id: None Aug 04 05:25:23.386485 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Domain-Name: None Aug 04 05:25:23.386485 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Identity-Status: Confirmed Aug 04 05:25:23.386485 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Is-Admin-Project: True Aug 04 05:25:23.386485 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Project-Domain-Id: default Aug 04 05:25:23.386485 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Project-Domain-Name: Default Aug 04 05:25:23.386485 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Project-Id: 820b25adb06d4245b9782065161f70b3 Aug 04 05:25:23.386485 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1086442173 Aug 04 05:25:23.386485 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Role: member,reader Aug 04 05:25:23.386485 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Roles: member,reader Aug 04 05:25:23.394691 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/820b25adb06d4245b9782065161f70b3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/820b25adb06d4245b9782065161f70b3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_820b25adb06d4245b9782065161f70b3", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/820b25adb06d4245b9782065161f70b3"}]}] Aug 04 05:25:23.394691 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1086442173 Aug 04 05:25:23.394691 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Tenant-Id: 820b25adb06d4245b9782065161f70b3 Aug 04 05:25:23.394691 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1086442173 Aug 04 05:25:23.394691 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-User: tempest-VolumesSnapshotsTestJSON-1086442173-project Aug 04 05:25:23.394691 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-User-Domain-Id: default Aug 04 05:25:23.394691 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-User-Domain-Name: Default Aug 04 05:25:23.394691 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-User-Id: a4c17d030bc245a18605be1d10f12419 Aug 04 05:25:23.394691 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1086442173-project Aug 04 05:25:23.394691 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: method: Aug 04 05:25:23.394691 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: exception: Volume 9696a9eb-21e7-4153-b7e2-99e4abbae478 could not be found. Aug 04 05:25:23.394691 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: action_args: {'id': '9696a9eb-21e7-4153-b7e2-99e4abbae478'} Aug 04 05:25:23.394691 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 05:25:23.395472 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:25:23.395472 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 04 05:25:23.395472 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 04 05:25:23.395472 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 04 05:25:23.395472 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 04 05:25:23.395472 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 04 05:25:23.395472 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 04 05:25:23.395472 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 04 05:25:23.395472 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 04 05:25:23.395472 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 04 05:25:23.395472 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 04 05:25:23.395472 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 04 05:25:23.395472 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 04 05:25:23.395472 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 04 05:25:23.395472 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 04 05:25:23.395472 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 9696a9eb-21e7-4153-b7e2-99e4abbae478 could not be found. (HTTP 404) (Request-ID: req-509cffba-3573-488c-89a1-8dce3dea710a) Aug 04 05:25:23.395472 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Aug 04 05:25:23.395472 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:25:23.395472 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Aug 04 05:25:23.396467 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:25:23.396467 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 04 05:25:23.396467 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 04 05:25:23.396467 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 04 05:25:23.396467 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 04 05:25:23.396467 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 04 05:25:23.396467 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 04 05:25:23.396467 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 04 05:25:23.396467 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 04 05:25:23.396467 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 04 05:25:23.396467 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 04 05:25:23.396467 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 04 05:25:23.396467 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 04 05:25:23.396467 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 04 05:25:23.396467 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 04 05:25:23.396467 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 04 05:25:23.396467 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 04 05:25:23.396467 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 04 05:25:23.396467 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 04 05:25:23.397405 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 04 05:25:23.397405 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 04 05:25:23.397405 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 04 05:25:23.397405 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 04 05:25:23.397405 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 9696a9eb-21e7-4153-b7e2-99e4abbae478 could not be found. Aug 04 05:25:23.397405 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Aug 04 05:25:23.397405 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:25:23.397405 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Aug 04 05:25:23.397405 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:25:23.397405 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:25:23.397405 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:25:23.397405 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 05:25:23.397405 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 05:25:23.397405 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 05:25:23.397405 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 05:25:23.397405 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 05:25:23.397405 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 05:25:23.397405 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 04 05:25:23.397405 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 05:25:23.398970 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 9696a9eb-21e7-4153-b7e2-99e4abbae478 could not be found. Aug 04 05:25:23.398970 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Aug 04 05:25:23.398970 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:25:23.398970 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Aug 04 05:25:23.398970 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:25:23.398970 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:25:23.398970 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:25:23.398970 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 05:25:23.398970 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 05:25:23.398970 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 9696a9eb-21e7-4153-b7e2-99e4abbae478 could not be found. Aug 04 05:25:23.398970 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Aug 04 05:25:23.398970 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-b493ab21-d78c-4b08-9f76-d59a9f6dd24f tempest-VolumesSnapshotsTestJSON-1086442173 tempest-VolumesSnapshotsTestJSON-1086442173-project] Returning 404 to user: Volume 9696a9eb-21e7-4153-b7e2-99e4abbae478 could not be found. {{(pid=118477) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 05:25:23.398970 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-b493ab21-d78c-4b08-9f76-d59a9f6dd24f tempest-VolumesSnapshotsTestJSON-1086442173 tempest-VolumesSnapshotsTestJSON-1086442173-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/9696a9eb-21e7-4153-b7e2-99e4abbae478" status: 404 len: 109 microversion: 2.1 time: 0.050411 Aug 04 05:25:23.398970 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 20/40] 10.222.0.46 () {58 vars in 1245 bytes} [Thu Aug 4 05:25:23 2022] GET /compute/v2.1/os-volumes/9696a9eb-21e7-4153-b7e2-99e4abbae478 => generated 109 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 05:25:23.399858 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-a8f4a5cc-ea5b-469d-b7d4-586bf03e03da tempest-VolumesTestJSON-286556406 tempest-VolumesTestJSON-286556406-project] Calling method '.version_select at 0x7f1475a27dc0>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:25:23.462610 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-9673d615-fbbf-4c97-b035-cbbeda120c1f tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e916e4e0fb7140b0912e9233898a0016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd41986c224f414b8768675f40682380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:25:23.478164 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-9673d615-fbbf-4c97-b035-cbbeda120c1f tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] 10.222.0.46 "GET /compute/v2.1/servers/5ad11a1d-cf86-446c-9e0a-db8e16d3fbeb" status: 200 len: 1275 microversion: 2.1 time: 0.105844 Aug 04 05:25:23.488079 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 21/41] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:25:23 2022] GET /compute/v2.1/servers/5ad11a1d-cf86-446c-9e0a-db8e16d3fbeb => generated 1275 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:25:23.489808 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-efea9637-a7ca-4cd6-995a-6a50b63ed13f tempest-VolumesSnapshotsTestJSON-1086442173 tempest-VolumesSnapshotsTestJSON-1086442173-project] Calling method '.version_select at 0x7f1476226b80>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:25:23.544010 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-a8f4a5cc-ea5b-469d-b7d4-586bf03e03da tempest-VolumesTestJSON-286556406 tempest-VolumesTestJSON-286556406-project] 10.222.0.46 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.153533 Aug 04 05:25:23.545117 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 21/42] 10.222.0.46 () {58 vars in 1149 bytes} [Thu Aug 4 05:25:23 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:25:23.550280 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-54d30df3-e86a-440f-a006-c456d091d979 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:25:23.551444 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-54d30df3-e86a-440f-a006-c456d091d979 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] [instance: 98f543b7-5432-4a4a-9494-63dac0f733b7] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:25:23.556486 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.wsgi [None req-efea9637-a7ca-4cd6-995a-6a50b63ed13f tempest-VolumesSnapshotsTestJSON-1086442173 tempest-VolumesSnapshotsTestJSON-1086442173-project] HTTP exception thrown: Volume 9696a9eb-21e7-4153-b7e2-99e4abbae478 could not be found. Aug 04 05:25:23.564747 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-efea9637-a7ca-4cd6-995a-6a50b63ed13f tempest-VolumesSnapshotsTestJSON-1086442173 tempest-VolumesSnapshotsTestJSON-1086442173-project] Request method failure captured: Aug 04 05:25:23.564747 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: request: DELETE /compute/v2.1/os-volumes/9696a9eb-21e7-4153-b7e2-99e4abbae478 HTTP/1.1 Aug 04 05:25:23.564747 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: Accept: application/json Aug 04 05:25:23.564747 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: Accept-Encoding: identity Aug 04 05:25:23.564747 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: Connection: close Aug 04 05:25:23.564747 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: Content-Length: 0 Aug 04 05:25:23.564747 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: Content-Type: application/json Aug 04 05:25:23.564747 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: Host: 10.222.0.46 Aug 04 05:25:23.564747 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: Openstack-System-Scope: None Aug 04 05:25:23.564747 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: User-Agent: python-urllib3/1.26.11 Aug 04 05:25:23.564747 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Auth-Token: gAAAAABi61gra1-LdpMFeUMdkPUm9yk3r1mpvVR7OzVXf3d0AfHd1wPPu4AKXtx-2NiKQx3sFDOp2vH0yMgGYr3j674aM48an0mszqbEqzv1vFmqr6MsdOdGjtUIgmsJlIdzXXbIRWxrJlMBX98dUsaN1r5_oy1oXHv84AfXRUHa1w-XT6w3ctU Aug 04 05:25:23.564747 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Domain-Id: None Aug 04 05:25:23.564747 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Domain-Name: None Aug 04 05:25:23.564747 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Identity-Status: Confirmed Aug 04 05:25:23.564747 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Is-Admin-Project: True Aug 04 05:25:23.564747 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Project-Domain-Id: default Aug 04 05:25:23.564747 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Project-Domain-Name: Default Aug 04 05:25:23.564747 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Project-Id: 820b25adb06d4245b9782065161f70b3 Aug 04 05:25:23.564747 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1086442173 Aug 04 05:25:23.564747 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Role: member,reader Aug 04 05:25:23.564747 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Roles: member,reader Aug 04 05:25:23.572690 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/820b25adb06d4245b9782065161f70b3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/820b25adb06d4245b9782065161f70b3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_820b25adb06d4245b9782065161f70b3", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/820b25adb06d4245b9782065161f70b3"}]}] Aug 04 05:25:23.572690 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1086442173 Aug 04 05:25:23.572690 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Tenant-Id: 820b25adb06d4245b9782065161f70b3 Aug 04 05:25:23.572690 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1086442173 Aug 04 05:25:23.572690 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-User: tempest-VolumesSnapshotsTestJSON-1086442173-project Aug 04 05:25:23.572690 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-User-Domain-Id: default Aug 04 05:25:23.572690 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-User-Domain-Name: Default Aug 04 05:25:23.572690 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-User-Id: a4c17d030bc245a18605be1d10f12419 Aug 04 05:25:23.572690 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1086442173-project Aug 04 05:25:23.572690 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: method: Aug 04 05:25:23.572690 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: exception: Volume 9696a9eb-21e7-4153-b7e2-99e4abbae478 could not be found. Aug 04 05:25:23.572690 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: action_args: {'id': '9696a9eb-21e7-4153-b7e2-99e4abbae478'} Aug 04 05:25:23.572690 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 05:25:23.573376 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:25:23.573376 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 04 05:25:23.573376 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 04 05:25:23.573376 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 04 05:25:23.573376 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 04 05:25:23.573376 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 04 05:25:23.573376 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 04 05:25:23.573376 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 04 05:25:23.573376 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 04 05:25:23.573376 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 04 05:25:23.573376 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 04 05:25:23.573376 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 04 05:25:23.573376 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 04 05:25:23.573376 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 04 05:25:23.573376 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 04 05:25:23.573376 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 9696a9eb-21e7-4153-b7e2-99e4abbae478 could not be found. (HTTP 404) (Request-ID: req-3295ae06-6316-443f-9877-461fc60eee85) Aug 04 05:25:23.573376 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Aug 04 05:25:23.573376 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:25:23.573376 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Aug 04 05:25:23.575201 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:25:23.575201 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 04 05:25:23.575201 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 04 05:25:23.575201 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 04 05:25:23.575201 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 04 05:25:23.575201 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 04 05:25:23.575201 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 04 05:25:23.575201 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 04 05:25:23.575201 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 04 05:25:23.575201 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 04 05:25:23.575201 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 04 05:25:23.575201 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 04 05:25:23.575201 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 04 05:25:23.575201 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 04 05:25:23.575201 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 04 05:25:23.575201 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 04 05:25:23.575201 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 04 05:25:23.575201 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 04 05:25:23.575201 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 04 05:25:23.576383 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 04 05:25:23.576383 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 04 05:25:23.576383 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 04 05:25:23.576383 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 04 05:25:23.576383 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 9696a9eb-21e7-4153-b7e2-99e4abbae478 could not be found. Aug 04 05:25:23.576383 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Aug 04 05:25:23.576383 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:25:23.576383 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Aug 04 05:25:23.576383 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:25:23.576383 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:25:23.576383 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:25:23.576383 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 05:25:23.576383 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 05:25:23.576383 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 05:25:23.576383 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 05:25:23.576383 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 05:25:23.576383 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 05:25:23.576383 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 04 05:25:23.576383 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 05:25:23.577281 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 9696a9eb-21e7-4153-b7e2-99e4abbae478 could not be found. Aug 04 05:25:23.577281 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Aug 04 05:25:23.577281 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:25:23.577281 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Aug 04 05:25:23.577281 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:25:23.577281 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:25:23.577281 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:25:23.577281 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 05:25:23.577281 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 05:25:23.577281 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 9696a9eb-21e7-4153-b7e2-99e4abbae478 could not be found. Aug 04 05:25:23.577281 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Aug 04 05:25:23.577281 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-efea9637-a7ca-4cd6-995a-6a50b63ed13f tempest-VolumesSnapshotsTestJSON-1086442173 tempest-VolumesSnapshotsTestJSON-1086442173-project] Returning 404 to user: Volume 9696a9eb-21e7-4153-b7e2-99e4abbae478 could not be found. {{(pid=118476) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 05:25:23.577281 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-efea9637-a7ca-4cd6-995a-6a50b63ed13f tempest-VolumesSnapshotsTestJSON-1086442173 tempest-VolumesSnapshotsTestJSON-1086442173-project] 10.222.0.46 "DELETE /compute/v2.1/os-volumes/9696a9eb-21e7-4153-b7e2-99e4abbae478" status: 404 len: 109 microversion: 2.1 time: 0.086203 Aug 04 05:25:23.577281 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 22/43] 10.222.0.46 () {58 vars in 1248 bytes} [Thu Aug 4 05:25:23 2022] DELETE /compute/v2.1/os-volumes/9696a9eb-21e7-4153-b7e2-99e4abbae478 => generated 109 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 05:25:23.586914 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-54d30df3-e86a-440f-a006-c456d091d979 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:25:23.587925 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-54d30df3-e86a-440f-a006-c456d091d979 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:25:23.589566 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-54d30df3-e86a-440f-a006-c456d091d979 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:25:23.590410 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-54d30df3-e86a-440f-a006-c456d091d979 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:25:23.596800 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-f3a7280d-1854-4c8a-991c-11194aa6d671 tempest-VolumesTestJSON-286556406 tempest-VolumesTestJSON-286556406-project] Calling method '.version_select at 0x7f1476198040>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:25:23.745485 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-54d30df3-e86a-440f-a006-c456d091d979 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8f887f5689419e9e31a0ba43f76ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62d19c831574f9b99c993b5e41c645d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:25:23.755904 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-54d30df3-e86a-440f-a006-c456d091d979 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] 10.222.0.46 "GET /compute/v2.1/servers/98f543b7-5432-4a4a-9494-63dac0f733b7" status: 200 len: 1282 microversion: 2.1 time: 0.209404 Aug 04 05:25:23.756700 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 22/44] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:25:23 2022] GET /compute/v2.1/servers/98f543b7-5432-4a4a-9494-63dac0f733b7 => generated 1282 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:25:23.762458 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-b4892fc0-15a4-4ac0-a7c0-f205b7acb232 tempest-VolumesSnapshotsTestJSON-1086442173 tempest-VolumesSnapshotsTestJSON-1086442173-project] Calling method '.version_select at 0x7f14759f3670>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:25:23.793881 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.wsgi [None req-b4892fc0-15a4-4ac0-a7c0-f205b7acb232 tempest-VolumesSnapshotsTestJSON-1086442173 tempest-VolumesSnapshotsTestJSON-1086442173-project] HTTP exception thrown: Volume 9696a9eb-21e7-4153-b7e2-99e4abbae478 could not be found. Aug 04 05:25:23.796641 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-b4892fc0-15a4-4ac0-a7c0-f205b7acb232 tempest-VolumesSnapshotsTestJSON-1086442173 tempest-VolumesSnapshotsTestJSON-1086442173-project] Request method failure captured: Aug 04 05:25:23.796641 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: request: GET /compute/v2.1/os-volumes/9696a9eb-21e7-4153-b7e2-99e4abbae478 HTTP/1.1 Aug 04 05:25:23.796641 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: Accept: application/json Aug 04 05:25:23.796641 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: Accept-Encoding: identity Aug 04 05:25:23.796641 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: Connection: close Aug 04 05:25:23.796641 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: Content-Length: 0 Aug 04 05:25:23.796641 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: Content-Type: application/json Aug 04 05:25:23.796641 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: Host: 10.222.0.46 Aug 04 05:25:23.796641 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: Openstack-System-Scope: None Aug 04 05:25:23.796641 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: User-Agent: python-urllib3/1.26.11 Aug 04 05:25:23.796641 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Auth-Token: gAAAAABi61gra1-LdpMFeUMdkPUm9yk3r1mpvVR7OzVXf3d0AfHd1wPPu4AKXtx-2NiKQx3sFDOp2vH0yMgGYr3j674aM48an0mszqbEqzv1vFmqr6MsdOdGjtUIgmsJlIdzXXbIRWxrJlMBX98dUsaN1r5_oy1oXHv84AfXRUHa1w-XT6w3ctU Aug 04 05:25:23.796641 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Domain-Id: None Aug 04 05:25:23.796641 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Domain-Name: None Aug 04 05:25:23.796641 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Identity-Status: Confirmed Aug 04 05:25:23.796641 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Is-Admin-Project: True Aug 04 05:25:23.796641 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Project-Domain-Id: default Aug 04 05:25:23.796641 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Project-Domain-Name: Default Aug 04 05:25:23.796641 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Project-Id: 820b25adb06d4245b9782065161f70b3 Aug 04 05:25:23.796641 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1086442173 Aug 04 05:25:23.796641 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Role: member,reader Aug 04 05:25:23.796641 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Roles: member,reader Aug 04 05:25:23.797680 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/820b25adb06d4245b9782065161f70b3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/820b25adb06d4245b9782065161f70b3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_820b25adb06d4245b9782065161f70b3", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/820b25adb06d4245b9782065161f70b3"}]}] Aug 04 05:25:23.797680 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1086442173 Aug 04 05:25:23.797680 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Tenant-Id: 820b25adb06d4245b9782065161f70b3 Aug 04 05:25:23.797680 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1086442173 Aug 04 05:25:23.797680 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-User: tempest-VolumesSnapshotsTestJSON-1086442173-project Aug 04 05:25:23.797680 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-User-Domain-Id: default Aug 04 05:25:23.797680 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-User-Domain-Name: Default Aug 04 05:25:23.797680 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-User-Id: a4c17d030bc245a18605be1d10f12419 Aug 04 05:25:23.797680 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1086442173-project Aug 04 05:25:23.797680 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: method: Aug 04 05:25:23.797680 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: exception: Volume 9696a9eb-21e7-4153-b7e2-99e4abbae478 could not be found. Aug 04 05:25:23.797680 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: action_args: {'id': '9696a9eb-21e7-4153-b7e2-99e4abbae478'} Aug 04 05:25:23.797680 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 05:25:23.798342 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:25:23.798342 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 04 05:25:23.798342 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 04 05:25:23.798342 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 04 05:25:23.798342 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 04 05:25:23.798342 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 04 05:25:23.798342 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 04 05:25:23.798342 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 04 05:25:23.798342 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 04 05:25:23.798342 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 04 05:25:23.798342 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 04 05:25:23.798342 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 04 05:25:23.798342 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 04 05:25:23.798342 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 04 05:25:23.798342 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 04 05:25:23.798342 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 9696a9eb-21e7-4153-b7e2-99e4abbae478 could not be found. (HTTP 404) (Request-ID: req-de0bfb3e-e2fb-49de-b587-bddcbd8b9633) Aug 04 05:25:23.798342 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Aug 04 05:25:23.798342 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:25:23.798342 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Aug 04 05:25:23.811532 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:25:23.811532 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 04 05:25:23.811532 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 04 05:25:23.811532 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 04 05:25:23.811532 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 04 05:25:23.811532 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 04 05:25:23.811532 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 04 05:25:23.811532 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 04 05:25:23.811532 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 04 05:25:23.811532 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 04 05:25:23.811532 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 04 05:25:23.811532 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 04 05:25:23.811532 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 04 05:25:23.811532 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 04 05:25:23.811532 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 04 05:25:23.811532 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 04 05:25:23.811532 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 04 05:25:23.811532 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 04 05:25:23.811532 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 04 05:25:23.813017 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 04 05:25:23.813017 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 04 05:25:23.813017 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 04 05:25:23.813017 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 04 05:25:23.813017 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 9696a9eb-21e7-4153-b7e2-99e4abbae478 could not be found. Aug 04 05:25:23.813017 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Aug 04 05:25:23.813017 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:25:23.813017 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Aug 04 05:25:23.813017 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:25:23.813017 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:25:23.813017 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:25:23.813017 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 05:25:23.813017 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 05:25:23.813017 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 05:25:23.813017 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 05:25:23.813017 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 05:25:23.813017 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 05:25:23.813017 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 04 05:25:23.813017 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 05:25:23.814036 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 9696a9eb-21e7-4153-b7e2-99e4abbae478 could not be found. Aug 04 05:25:23.814036 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Aug 04 05:25:23.814036 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:25:23.814036 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Aug 04 05:25:23.814036 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:25:23.814036 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:25:23.814036 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:25:23.814036 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 05:25:23.814036 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 05:25:23.814036 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 9696a9eb-21e7-4153-b7e2-99e4abbae478 could not be found. Aug 04 05:25:23.814036 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Aug 04 05:25:23.818168 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-f3a7280d-1854-4c8a-991c-11194aa6d671 tempest-VolumesTestJSON-286556406 tempest-VolumesTestJSON-286556406-project] 10.222.0.46 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.220502 Aug 04 05:25:23.818168 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 23/45] 10.222.0.46 () {58 vars in 1134 bytes} [Thu Aug 4 05:25:23 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:25:23.818484 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-b4892fc0-15a4-4ac0-a7c0-f205b7acb232 tempest-VolumesSnapshotsTestJSON-1086442173 tempest-VolumesSnapshotsTestJSON-1086442173-project] Returning 404 to user: Volume 9696a9eb-21e7-4153-b7e2-99e4abbae478 could not be found. {{(pid=118477) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 05:25:23.818484 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-b4892fc0-15a4-4ac0-a7c0-f205b7acb232 tempest-VolumesSnapshotsTestJSON-1086442173 tempest-VolumesSnapshotsTestJSON-1086442173-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/9696a9eb-21e7-4153-b7e2-99e4abbae478" status: 404 len: 109 microversion: 2.1 time: 0.043815 Aug 04 05:25:23.819170 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 23/46] 10.222.0.46 () {58 vars in 1245 bytes} [Thu Aug 4 05:25:23 2022] GET /compute/v2.1/os-volumes/9696a9eb-21e7-4153-b7e2-99e4abbae478 => generated 109 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 05:25:23.822024 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-98a38ed9-7fe9-49cf-815c-95f5aad856ed tempest-VolumesTestJSON-286556406 tempest-VolumesTestJSON-286556406-project] Calling method '.version_select at 0x7f14762261f0>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:25:23.944751 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-98a38ed9-7fe9-49cf-815c-95f5aad856ed tempest-VolumesTestJSON-286556406 tempest-VolumesTestJSON-286556406-project] 10.222.0.46 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.126160 Aug 04 05:25:23.945759 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 24/47] 10.222.0.46 () {58 vars in 1167 bytes} [Thu Aug 4 05:25:23 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:25:23.960090 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-ebc3e8f1-990a-4e91-8a55-e0b75ceb1e37 tempest-VolumesTestJSON-286556406 tempest-VolumesTestJSON-286556406-project] Calling method '.version_select at 0x7f1476aed3a0>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:25:24.052411 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-ebc3e8f1-990a-4e91-8a55-e0b75ceb1e37 tempest-VolumesTestJSON-286556406 tempest-VolumesTestJSON-286556406-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.093150 Aug 04 05:25:24.052411 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 24/48] 10.222.0.46 () {58 vars in 1170 bytes} [Thu Aug 4 05:25:23 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 05:25:24.065552 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-164e8a1c-c8b5-409d-8cce-cf680dac8969 tempest-VolumesTestJSON-286556406 tempest-VolumesTestJSON-286556406-project] Calling method '.version_select at 0x7f1476198ee0>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:25:24.171975 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-164e8a1c-c8b5-409d-8cce-cf680dac8969 tempest-VolumesTestJSON-286556406 tempest-VolumesTestJSON-286556406-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.111130 Aug 04 05:25:24.173334 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 25/49] 10.222.0.46 () {58 vars in 1155 bytes} [Thu Aug 4 05:25:24 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:25:24.188701 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-8bb641b5-09bf-4796-8dfe-c557a559710a tempest-VolumesTestJSON-286556406 tempest-VolumesTestJSON-286556406-project] Calling method '.version_select at 0x7f14759a1f70>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:25:24.272014 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-8bb641b5-09bf-4796-8dfe-c557a559710a tempest-VolumesTestJSON-286556406 tempest-VolumesTestJSON-286556406-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.087073 Aug 04 05:25:24.272665 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 25/50] 10.222.0.46 () {58 vars in 1188 bytes} [Thu Aug 4 05:25:24 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:25:24.286057 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-6c34ee11-34e7-4a35-85dd-18218fd66a4c tempest-VolumesTestJSON-286556406 tempest-VolumesTestJSON-286556406-project] Calling method '.version_select at 0x7f147613d670>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:25:24.353899 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-2ba0f67e-d409-4f08-b5b6-9e39f3cc5c63 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:25:24.356232 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-2ba0f67e-d409-4f08-b5b6-9e39f3cc5c63 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] [instance: 384721d7-1467-45cd-af93-eb458115f75e] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:25:24.371655 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-2ba0f67e-d409-4f08-b5b6-9e39f3cc5c63 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:25:24.372708 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-2ba0f67e-d409-4f08-b5b6-9e39f3cc5c63 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:25:24.374131 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-2ba0f67e-d409-4f08-b5b6-9e39f3cc5c63 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:25:24.374932 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-2ba0f67e-d409-4f08-b5b6-9e39f3cc5c63 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:25:24.396717 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-6c34ee11-34e7-4a35-85dd-18218fd66a4c tempest-VolumesTestJSON-286556406 tempest-VolumesTestJSON-286556406-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.114163 Aug 04 05:25:24.398020 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 26/51] 10.222.0.46 () {58 vars in 1155 bytes} [Thu Aug 4 05:25:24 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:25:24.471774 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-2ba0f67e-d409-4f08-b5b6-9e39f3cc5c63 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb49b631c234f9a9fd47049b9b2e097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faead990837d43de8ec54bfaf24361de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:25:24.502450 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-2ba0f67e-d409-4f08-b5b6-9e39f3cc5c63 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] 10.222.0.46 "GET /compute/v2.1/servers/384721d7-1467-45cd-af93-eb458115f75e" status: 200 len: 1300 microversion: 2.1 time: 0.155798 Aug 04 05:25:24.503970 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 26/52] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:25:24 2022] GET /compute/v2.1/servers/384721d7-1467-45cd-af93-eb458115f75e => generated 1300 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 05:25:24.514234 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-a501c9c1-543b-43eb-b902-0979a8857ece tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:25:24.515602 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-a501c9c1-543b-43eb-b902-0979a8857ece tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] [instance: 5ad11a1d-cf86-446c-9e0a-db8e16d3fbeb] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:25:24.529950 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-a501c9c1-543b-43eb-b902-0979a8857ece tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:25:24.531097 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-a501c9c1-543b-43eb-b902-0979a8857ece tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:25:24.532608 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-a501c9c1-543b-43eb-b902-0979a8857ece tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:25:24.533555 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-a501c9c1-543b-43eb-b902-0979a8857ece tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:25:24.657303 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-a501c9c1-543b-43eb-b902-0979a8857ece tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e916e4e0fb7140b0912e9233898a0016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd41986c224f414b8768675f40682380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:25:24.668014 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-a501c9c1-543b-43eb-b902-0979a8857ece tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] 10.222.0.46 "GET /compute/v2.1/servers/5ad11a1d-cf86-446c-9e0a-db8e16d3fbeb" status: 200 len: 1285 microversion: 2.1 time: 0.165515 Aug 04 05:25:24.668859 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 27/53] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:25:24 2022] GET /compute/v2.1/servers/5ad11a1d-cf86-446c-9e0a-db8e16d3fbeb => generated 1285 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:25:24.782226 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-8ecbd62f-cd45-4b57-94f3-cc7439d60e67 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:25:24.783106 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-8ecbd62f-cd45-4b57-94f3-cc7439d60e67 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] [instance: 98f543b7-5432-4a4a-9494-63dac0f733b7] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:25:24.790779 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-8ecbd62f-cd45-4b57-94f3-cc7439d60e67 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:25:24.791250 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-8ecbd62f-cd45-4b57-94f3-cc7439d60e67 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:25:24.793394 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-8ecbd62f-cd45-4b57-94f3-cc7439d60e67 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:25:24.794156 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-8ecbd62f-cd45-4b57-94f3-cc7439d60e67 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:25:24.886838 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-8ecbd62f-cd45-4b57-94f3-cc7439d60e67 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8f887f5689419e9e31a0ba43f76ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62d19c831574f9b99c993b5e41c645d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:25:24.895762 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-8ecbd62f-cd45-4b57-94f3-cc7439d60e67 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] 10.222.0.46 "GET /compute/v2.1/servers/98f543b7-5432-4a4a-9494-63dac0f733b7" status: 200 len: 1282 microversion: 2.1 time: 0.118497 Aug 04 05:25:24.896498 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 27/54] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:25:24 2022] GET /compute/v2.1/servers/98f543b7-5432-4a4a-9494-63dac0f733b7 => generated 1282 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:25:25.524689 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-51a6e17f-ef03-481b-b03c-aced5209a4da tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:25:25.525332 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-51a6e17f-ef03-481b-b03c-aced5209a4da tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] [instance: 384721d7-1467-45cd-af93-eb458115f75e] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:25:25.532186 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-51a6e17f-ef03-481b-b03c-aced5209a4da tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:25:25.532537 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-51a6e17f-ef03-481b-b03c-aced5209a4da tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:25:25.533313 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-51a6e17f-ef03-481b-b03c-aced5209a4da tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:25:25.533756 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-51a6e17f-ef03-481b-b03c-aced5209a4da tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:25:25.602467 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-51a6e17f-ef03-481b-b03c-aced5209a4da tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb49b631c234f9a9fd47049b9b2e097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faead990837d43de8ec54bfaf24361de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:25:25.613399 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-51a6e17f-ef03-481b-b03c-aced5209a4da tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] 10.222.0.46 "GET /compute/v2.1/servers/384721d7-1467-45cd-af93-eb458115f75e" status: 200 len: 1310 microversion: 2.1 time: 0.092576 Aug 04 05:25:25.613992 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 28/55] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:25:25 2022] GET /compute/v2.1/servers/384721d7-1467-45cd-af93-eb458115f75e => generated 1310 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:25:25.691076 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-a5c0da4d-d783-4416-9125-62483513df5f tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:25:25.691811 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-a5c0da4d-d783-4416-9125-62483513df5f tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] [instance: 5ad11a1d-cf86-446c-9e0a-db8e16d3fbeb] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:25:25.699381 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-a5c0da4d-d783-4416-9125-62483513df5f tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:25:25.699848 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-a5c0da4d-d783-4416-9125-62483513df5f tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:25:25.700666 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-a5c0da4d-d783-4416-9125-62483513df5f tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:25:25.701106 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-a5c0da4d-d783-4416-9125-62483513df5f tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:25:25.775126 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-a5c0da4d-d783-4416-9125-62483513df5f tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e916e4e0fb7140b0912e9233898a0016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd41986c224f414b8768675f40682380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:25:25.786927 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-a5c0da4d-d783-4416-9125-62483513df5f tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] 10.222.0.46 "GET /compute/v2.1/servers/5ad11a1d-cf86-446c-9e0a-db8e16d3fbeb" status: 200 len: 1285 microversion: 2.1 time: 0.099635 Aug 04 05:25:25.787625 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 28/56] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:25:25 2022] GET /compute/v2.1/servers/5ad11a1d-cf86-446c-9e0a-db8e16d3fbeb => generated 1285 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:25:25.924690 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-aa381b7d-af5c-4ac9-8fdb-6d0b6e29a1ce tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:25:25.925514 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-aa381b7d-af5c-4ac9-8fdb-6d0b6e29a1ce tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] [instance: 98f543b7-5432-4a4a-9494-63dac0f733b7] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:25:25.932118 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-aa381b7d-af5c-4ac9-8fdb-6d0b6e29a1ce tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:25:25.933461 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-aa381b7d-af5c-4ac9-8fdb-6d0b6e29a1ce tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:25:25.934535 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-aa381b7d-af5c-4ac9-8fdb-6d0b6e29a1ce tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:25:25.935045 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-aa381b7d-af5c-4ac9-8fdb-6d0b6e29a1ce tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:25:26.024448 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-aa381b7d-af5c-4ac9-8fdb-6d0b6e29a1ce tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8f887f5689419e9e31a0ba43f76ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62d19c831574f9b99c993b5e41c645d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:25:26.035897 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-aa381b7d-af5c-4ac9-8fdb-6d0b6e29a1ce tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] 10.222.0.46 "GET /compute/v2.1/servers/98f543b7-5432-4a4a-9494-63dac0f733b7" status: 200 len: 1282 microversion: 2.1 time: 0.114785 Aug 04 05:25:26.050087 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 29/57] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:25:25 2022] GET /compute/v2.1/servers/98f543b7-5432-4a4a-9494-63dac0f733b7 => generated 1282 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:25:26.635699 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-0419db89-49e9-4581-a8bd-ab154da363cb tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:25:26.636330 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-0419db89-49e9-4581-a8bd-ab154da363cb tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] [instance: 384721d7-1467-45cd-af93-eb458115f75e] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:25:26.646056 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-0419db89-49e9-4581-a8bd-ab154da363cb tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:25:26.646547 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-0419db89-49e9-4581-a8bd-ab154da363cb tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:25:26.657681 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-0419db89-49e9-4581-a8bd-ab154da363cb tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:25:26.658521 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-0419db89-49e9-4581-a8bd-ab154da363cb tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:25:26.876010 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-5c3db1a9-8fb0-495b-a12f-4f27a4b4bed9 tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:25:26.886947 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-5c3db1a9-8fb0-495b-a12f-4f27a4b4bed9 tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] [instance: 5ad11a1d-cf86-446c-9e0a-db8e16d3fbeb] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:25:26.904184 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-5c3db1a9-8fb0-495b-a12f-4f27a4b4bed9 tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:25:26.906159 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-5c3db1a9-8fb0-495b-a12f-4f27a4b4bed9 tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:25:26.907468 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-5c3db1a9-8fb0-495b-a12f-4f27a4b4bed9 tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:25:26.910617 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-5c3db1a9-8fb0-495b-a12f-4f27a4b4bed9 tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:25:27.187386 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-0419db89-49e9-4581-a8bd-ab154da363cb tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb49b631c234f9a9fd47049b9b2e097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faead990837d43de8ec54bfaf24361de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:25:27.205361 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-0419db89-49e9-4581-a8bd-ab154da363cb tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] 10.222.0.46 "GET /compute/v2.1/servers/384721d7-1467-45cd-af93-eb458115f75e" status: 200 len: 1298 microversion: 2.1 time: 0.573702 Aug 04 05:25:27.218660 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 29/58] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:25:26 2022] GET /compute/v2.1/servers/384721d7-1467-45cd-af93-eb458115f75e => generated 1298 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:25:27.223508 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-acd4e686-565b-4ee6-86bf-db89027e146c tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:25:27.224405 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-acd4e686-565b-4ee6-86bf-db89027e146c tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] [instance: 98f543b7-5432-4a4a-9494-63dac0f733b7] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:25:27.231109 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-5c3db1a9-8fb0-495b-a12f-4f27a4b4bed9 tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e916e4e0fb7140b0912e9233898a0016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd41986c224f414b8768675f40682380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:25:27.245554 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-acd4e686-565b-4ee6-86bf-db89027e146c tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:25:27.245554 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-acd4e686-565b-4ee6-86bf-db89027e146c tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:25:27.245554 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-acd4e686-565b-4ee6-86bf-db89027e146c tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:25:27.245554 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-acd4e686-565b-4ee6-86bf-db89027e146c tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:25:27.255004 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-5c3db1a9-8fb0-495b-a12f-4f27a4b4bed9 tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] 10.222.0.46 "GET /compute/v2.1/servers/5ad11a1d-cf86-446c-9e0a-db8e16d3fbeb" status: 200 len: 1273 microversion: 2.1 time: 0.426188 Aug 04 05:25:27.255601 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 30/59] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:25:26 2022] GET /compute/v2.1/servers/5ad11a1d-cf86-446c-9e0a-db8e16d3fbeb => generated 1273 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:25:27.371297 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-acd4e686-565b-4ee6-86bf-db89027e146c tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8f887f5689419e9e31a0ba43f76ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62d19c831574f9b99c993b5e41c645d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:25:27.391869 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-acd4e686-565b-4ee6-86bf-db89027e146c tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] 10.222.0.46 "GET /compute/v2.1/servers/98f543b7-5432-4a4a-9494-63dac0f733b7" status: 200 len: 1280 microversion: 2.1 time: 0.182928 Aug 04 05:25:27.404373 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 30/60] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:25:27 2022] GET /compute/v2.1/servers/98f543b7-5432-4a4a-9494-63dac0f733b7 => generated 1280 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:25:28.238419 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-42aa051c-bcfd-4ba1-8cf1-8a142279a740 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:25:28.239691 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-42aa051c-bcfd-4ba1-8cf1-8a142279a740 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] [instance: 384721d7-1467-45cd-af93-eb458115f75e] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:25:28.252701 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-42aa051c-bcfd-4ba1-8cf1-8a142279a740 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:25:28.255890 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-42aa051c-bcfd-4ba1-8cf1-8a142279a740 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:25:28.259838 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-42aa051c-bcfd-4ba1-8cf1-8a142279a740 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:25:28.261466 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-42aa051c-bcfd-4ba1-8cf1-8a142279a740 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:25:28.287694 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-fea4d47b-690c-413d-bfd6-9b608c322c06 tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:25:28.293656 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-fea4d47b-690c-413d-bfd6-9b608c322c06 tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] [instance: 5ad11a1d-cf86-446c-9e0a-db8e16d3fbeb] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:25:28.325957 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG dbcounter [-] [118477] Writing DB stats nova_cell0:SELECT=4 {{(pid=118477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:25:28.336137 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-fea4d47b-690c-413d-bfd6-9b608c322c06 tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:25:28.339911 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-fea4d47b-690c-413d-bfd6-9b608c322c06 tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:25:28.342775 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-fea4d47b-690c-413d-bfd6-9b608c322c06 tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:25:28.346123 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-fea4d47b-690c-413d-bfd6-9b608c322c06 tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:25:29.233617 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-fea4d47b-690c-413d-bfd6-9b608c322c06 tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e916e4e0fb7140b0912e9233898a0016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd41986c224f414b8768675f40682380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:25:29.306533 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-fea4d47b-690c-413d-bfd6-9b608c322c06 tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] 10.222.0.46 "GET /compute/v2.1/servers/5ad11a1d-cf86-446c-9e0a-db8e16d3fbeb" status: 200 len: 1315 microversion: 2.1 time: 1.031412 Aug 04 05:25:29.316843 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 31/61] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:25:28 2022] GET /compute/v2.1/servers/5ad11a1d-cf86-446c-9e0a-db8e16d3fbeb => generated 1315 bytes in 1043 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:25:29.348469 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-dd33f89f-6512-49f5-871d-befff1452ca2 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:25:29.362912 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-dd33f89f-6512-49f5-871d-befff1452ca2 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] [instance: 98f543b7-5432-4a4a-9494-63dac0f733b7] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:25:29.377138 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-42aa051c-bcfd-4ba1-8cf1-8a142279a740 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb49b631c234f9a9fd47049b9b2e097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faead990837d43de8ec54bfaf24361de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:25:29.422020 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-dd33f89f-6512-49f5-871d-befff1452ca2 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:25:29.422778 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-dd33f89f-6512-49f5-871d-befff1452ca2 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:25:29.424006 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-dd33f89f-6512-49f5-871d-befff1452ca2 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:25:29.424667 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-dd33f89f-6512-49f5-871d-befff1452ca2 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:25:29.429686 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-42aa051c-bcfd-4ba1-8cf1-8a142279a740 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] 10.222.0.46 "GET /compute/v2.1/servers/384721d7-1467-45cd-af93-eb458115f75e" status: 200 len: 1366 microversion: 2.1 time: 1.196416 Aug 04 05:25:29.437705 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 31/62] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:25:28 2022] GET /compute/v2.1/servers/384721d7-1467-45cd-af93-eb458115f75e => generated 1366 bytes in 1205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 05:25:29.735463 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG dbcounter [-] [118477] Writing DB stats nova_cell0:SELECT=20 {{(pid=118477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:25:30.347232 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-af0b5472-e6f0-4be1-91f4-cc1bba1fa5ac tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:25:30.351241 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-af0b5472-e6f0-4be1-91f4-cc1bba1fa5ac tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] [instance: 5ad11a1d-cf86-446c-9e0a-db8e16d3fbeb] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:25:30.369242 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG dbcounter [-] [118476] Writing DB stats nova_cell0:SELECT=4 {{(pid=118476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:25:30.372743 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG dbcounter [-] [118476] Writing DB stats nova_cell0:SELECT=20 {{(pid=118476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:25:30.394444 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-dd33f89f-6512-49f5-871d-befff1452ca2 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8f887f5689419e9e31a0ba43f76ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62d19c831574f9b99c993b5e41c645d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:25:30.409991 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-af0b5472-e6f0-4be1-91f4-cc1bba1fa5ac tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:25:30.415808 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-af0b5472-e6f0-4be1-91f4-cc1bba1fa5ac tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:25:30.419846 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-dd33f89f-6512-49f5-871d-befff1452ca2 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] 10.222.0.46 "GET /compute/v2.1/servers/98f543b7-5432-4a4a-9494-63dac0f733b7" status: 200 len: 1322 microversion: 2.1 time: 1.101162 Aug 04 05:25:30.421361 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-af0b5472-e6f0-4be1-91f4-cc1bba1fa5ac tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:25:30.427194 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-af0b5472-e6f0-4be1-91f4-cc1bba1fa5ac tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:25:30.427751 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 32/63] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:25:29 2022] GET /compute/v2.1/servers/98f543b7-5432-4a4a-9494-63dac0f733b7 => generated 1322 bytes in 1110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:25:30.487341 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-9ffd110f-b4b1-476a-9a37-fd6653046cb8 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:25:30.488343 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-9ffd110f-b4b1-476a-9a37-fd6653046cb8 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] [instance: 384721d7-1467-45cd-af93-eb458115f75e] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:25:30.490483 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG dbcounter [-] [118477] Writing DB stats nova_api:SELECT=70,nova_api:INSERT=7 {{(pid=118477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:25:30.515687 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-9ffd110f-b4b1-476a-9a37-fd6653046cb8 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:25:30.516199 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-9ffd110f-b4b1-476a-9a37-fd6653046cb8 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:25:30.517010 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-9ffd110f-b4b1-476a-9a37-fd6653046cb8 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:25:30.517450 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-9ffd110f-b4b1-476a-9a37-fd6653046cb8 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:25:31.439425 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-af0b5472-e6f0-4be1-91f4-cc1bba1fa5ac tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e916e4e0fb7140b0912e9233898a0016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd41986c224f414b8768675f40682380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:25:31.451052 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-af0b5472-e6f0-4be1-91f4-cc1bba1fa5ac tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] 10.222.0.46 "GET /compute/v2.1/servers/5ad11a1d-cf86-446c-9e0a-db8e16d3fbeb" status: 200 len: 1315 microversion: 2.1 time: 1.116905 Aug 04 05:25:31.461248 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 32/64] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:25:30 2022] GET /compute/v2.1/servers/5ad11a1d-cf86-446c-9e0a-db8e16d3fbeb => generated 1315 bytes in 1128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 05:25:31.486739 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-9ffd110f-b4b1-476a-9a37-fd6653046cb8 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb49b631c234f9a9fd47049b9b2e097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faead990837d43de8ec54bfaf24361de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:25:31.487395 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-89920392-6600-4c80-ba13-f8a33c3c0d0b tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:25:31.487904 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-89920392-6600-4c80-ba13-f8a33c3c0d0b tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] [instance: 98f543b7-5432-4a4a-9494-63dac0f733b7] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:25:31.503779 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-89920392-6600-4c80-ba13-f8a33c3c0d0b tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:25:31.507557 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-89920392-6600-4c80-ba13-f8a33c3c0d0b tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:25:31.511964 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-89920392-6600-4c80-ba13-f8a33c3c0d0b tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:25:31.513209 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-89920392-6600-4c80-ba13-f8a33c3c0d0b tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:25:31.536800 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-9ffd110f-b4b1-476a-9a37-fd6653046cb8 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] 10.222.0.46 "GET /compute/v2.1/servers/384721d7-1467-45cd-af93-eb458115f75e" status: 200 len: 1366 microversion: 2.1 time: 1.053271 Aug 04 05:25:31.539938 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 33/65] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:25:30 2022] GET /compute/v2.1/servers/384721d7-1467-45cd-af93-eb458115f75e => generated 1366 bytes in 1057 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:25:31.864089 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-89920392-6600-4c80-ba13-f8a33c3c0d0b tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8f887f5689419e9e31a0ba43f76ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62d19c831574f9b99c993b5e41c645d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:25:31.877161 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-89920392-6600-4c80-ba13-f8a33c3c0d0b tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] 10.222.0.46 "GET /compute/v2.1/servers/98f543b7-5432-4a4a-9494-63dac0f733b7" status: 200 len: 1322 microversion: 2.1 time: 0.413693 Aug 04 05:25:31.878610 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 33/66] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:25:31 2022] GET /compute/v2.1/servers/98f543b7-5432-4a4a-9494-63dac0f733b7 => generated 1322 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:25:32.475119 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-c1713b95-8e3b-4961-91ef-9a20d46956ef tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:25:32.476246 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-c1713b95-8e3b-4961-91ef-9a20d46956ef tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] [instance: 5ad11a1d-cf86-446c-9e0a-db8e16d3fbeb] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:25:32.483195 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-c1713b95-8e3b-4961-91ef-9a20d46956ef tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:25:32.484011 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-c1713b95-8e3b-4961-91ef-9a20d46956ef tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:25:32.485029 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-c1713b95-8e3b-4961-91ef-9a20d46956ef tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:25:32.485829 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-c1713b95-8e3b-4961-91ef-9a20d46956ef tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:25:32.578192 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-87e64512-80ec-406f-bfe4-97677fe6246b tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:25:32.579971 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-87e64512-80ec-406f-bfe4-97677fe6246b tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] [instance: 384721d7-1467-45cd-af93-eb458115f75e] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:25:32.603730 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-87e64512-80ec-406f-bfe4-97677fe6246b tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:25:32.604208 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-87e64512-80ec-406f-bfe4-97677fe6246b tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:25:32.605035 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-87e64512-80ec-406f-bfe4-97677fe6246b tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:25:32.605527 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-87e64512-80ec-406f-bfe4-97677fe6246b tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:25:32.966916 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-c1713b95-8e3b-4961-91ef-9a20d46956ef tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e916e4e0fb7140b0912e9233898a0016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd41986c224f414b8768675f40682380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:25:32.966916 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-c1713b95-8e3b-4961-91ef-9a20d46956ef tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] 10.222.0.46 "GET /compute/v2.1/servers/5ad11a1d-cf86-446c-9e0a-db8e16d3fbeb" status: 200 len: 1315 microversion: 2.1 time: 0.490819 Aug 04 05:25:32.970206 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 34/67] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:25:32 2022] GET /compute/v2.1/servers/5ad11a1d-cf86-446c-9e0a-db8e16d3fbeb => generated 1315 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:25:32.997395 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-53826de8-a2c1-457e-b439-fae50f25bacb tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:25:32.998032 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-53826de8-a2c1-457e-b439-fae50f25bacb tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] [instance: 98f543b7-5432-4a4a-9494-63dac0f733b7] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:25:33.041182 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-53826de8-a2c1-457e-b439-fae50f25bacb tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:25:33.045519 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-53826de8-a2c1-457e-b439-fae50f25bacb tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:25:33.046641 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-53826de8-a2c1-457e-b439-fae50f25bacb tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:25:33.048245 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-53826de8-a2c1-457e-b439-fae50f25bacb tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:25:33.114693 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-87e64512-80ec-406f-bfe4-97677fe6246b tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb49b631c234f9a9fd47049b9b2e097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faead990837d43de8ec54bfaf24361de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:25:33.126551 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-87e64512-80ec-406f-bfe4-97677fe6246b tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] 10.222.0.46 "GET /compute/v2.1/servers/384721d7-1467-45cd-af93-eb458115f75e" status: 200 len: 1366 microversion: 2.1 time: 0.553139 Aug 04 05:25:33.127167 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 34/68] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:25:32 2022] GET /compute/v2.1/servers/384721d7-1467-45cd-af93-eb458115f75e => generated 1366 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 05:25:33.237459 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [req-db517281-7ec8-498a-9d7d-be204190f63e req-822caca5-a5e1-4afb-a71c-2b76c11300d6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "98f543b7-5432-4a4a-9494-63dac0f733b7", "tag": "f35fb18f-8eba-4e19-9262-240ca4bdb983"}]} {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:25:33.253525 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [req-db517281-7ec8-498a-9d7d-be204190f63e req-822caca5-a5e1-4afb-a71c-2b76c11300d6 service nova] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:25:33.253970 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [req-db517281-7ec8-498a-9d7d-be204190f63e req-822caca5-a5e1-4afb-a71c-2b76c11300d6 service nova] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:25:33.273113 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.compute.server_external_events [req-db517281-7ec8-498a-9d7d-be204190f63e req-822caca5-a5e1-4afb-a71c-2b76c11300d6 service nova] Creating event network-changed:f35fb18f-8eba-4e19-9262-240ca4bdb983 for instance 98f543b7-5432-4a4a-9494-63dac0f733b7 on hv-cinder-85207 Aug 04 05:25:33.273668 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [req-db517281-7ec8-498a-9d7d-be204190f63e req-822caca5-a5e1-4afb-a71c-2b76c11300d6 service nova] Acquired lock "compute-rpcapi-router" {{(pid=118476) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Aug 04 05:25:33.286615 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-128ce49e-6f7d-4e2d-a1e2-9ed1b5b9b50c None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:25:33.286615 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-128ce49e-6f7d-4e2d-a1e2-9ed1b5b9b50c None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:25:33.286765 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-53826de8-a2c1-457e-b439-fae50f25bacb tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8f887f5689419e9e31a0ba43f76ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62d19c831574f9b99c993b5e41c645d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:25:33.286862 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-128ce49e-6f7d-4e2d-a1e2-9ed1b5b9b50c None None] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:25:33.286862 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-128ce49e-6f7d-4e2d-a1e2-9ed1b5b9b50c None None] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:25:33.288136 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-53826de8-a2c1-457e-b439-fae50f25bacb tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] 10.222.0.46 "GET /compute/v2.1/servers/98f543b7-5432-4a4a-9494-63dac0f733b7" status: 200 len: 1322 microversion: 2.1 time: 0.317073 Aug 04 05:25:33.288918 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 35/69] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:25:32 2022] GET /compute/v2.1/servers/98f543b7-5432-4a4a-9494-63dac0f733b7 => generated 1322 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:25:33.304533 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.compute.rpcapi [None req-128ce49e-6f7d-4e2d-a1e2-9ed1b5b9b50c None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 04 05:25:33.305511 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-128ce49e-6f7d-4e2d-a1e2-9ed1b5b9b50c None None] Releasing lock "compute-rpcapi-router" {{(pid=118476) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Aug 04 05:25:33.324906 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-128ce49e-6f7d-4e2d-a1e2-9ed1b5b9b50c None None] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.172329 Aug 04 05:25:33.325530 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 35/70] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Aug 4 05:25:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 05:25:33.356177 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [req-979fb872-dad6-43a9-b743-5117492ec412 req-8e2e54cf-2bdb-469e-85fe-d9979ef82b36 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "384721d7-1467-45cd-af93-eb458115f75e", "tag": "7d9439ea-7e8f-45ca-beda-13020209ac61"}]} {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:25:33.369736 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [req-979fb872-dad6-43a9-b743-5117492ec412 req-8e2e54cf-2bdb-469e-85fe-d9979ef82b36 service nova] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:25:33.370243 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [req-979fb872-dad6-43a9-b743-5117492ec412 req-8e2e54cf-2bdb-469e-85fe-d9979ef82b36 service nova] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:25:33.390883 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.compute.server_external_events [req-979fb872-dad6-43a9-b743-5117492ec412 req-8e2e54cf-2bdb-469e-85fe-d9979ef82b36 service nova] Creating event network-changed:7d9439ea-7e8f-45ca-beda-13020209ac61 for instance 384721d7-1467-45cd-af93-eb458115f75e on hv-cinder-85207 Aug 04 05:25:33.391410 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [req-979fb872-dad6-43a9-b743-5117492ec412 req-8e2e54cf-2bdb-469e-85fe-d9979ef82b36 service nova] Acquired lock "compute-rpcapi-router" {{(pid=118477) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Aug 04 05:25:33.393382 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-aa8730ce-bb9e-4ba7-b7e0-513b4d1fcc30 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:25:33.393382 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-aa8730ce-bb9e-4ba7-b7e0-513b4d1fcc30 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:25:33.393775 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-aa8730ce-bb9e-4ba7-b7e0-513b4d1fcc30 None None] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:25:33.394222 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-aa8730ce-bb9e-4ba7-b7e0-513b4d1fcc30 None None] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:25:33.403931 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.compute.rpcapi [None req-aa8730ce-bb9e-4ba7-b7e0-513b4d1fcc30 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 04 05:25:33.404879 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-aa8730ce-bb9e-4ba7-b7e0-513b4d1fcc30 None None] Releasing lock "compute-rpcapi-router" {{(pid=118477) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Aug 04 05:25:33.423687 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-aa8730ce-bb9e-4ba7-b7e0-513b4d1fcc30 None None] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.133193 Aug 04 05:25:33.424310 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 36/71] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Aug 4 05:25:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:25:33.990675 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-116e5444-43ca-4f8b-ac59-3d5e0e3cb54a tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:25:33.991388 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-116e5444-43ca-4f8b-ac59-3d5e0e3cb54a tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] [instance: 5ad11a1d-cf86-446c-9e0a-db8e16d3fbeb] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:25:34.000262 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-116e5444-43ca-4f8b-ac59-3d5e0e3cb54a tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:25:34.000695 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-116e5444-43ca-4f8b-ac59-3d5e0e3cb54a tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:25:34.001672 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-116e5444-43ca-4f8b-ac59-3d5e0e3cb54a tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:25:34.002010 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-116e5444-43ca-4f8b-ac59-3d5e0e3cb54a tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:25:34.149285 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-e1ea5dd5-0366-40f7-b6c7-1e8b74ca0c6b tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:25:34.150680 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-e1ea5dd5-0366-40f7-b6c7-1e8b74ca0c6b tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] [instance: 384721d7-1467-45cd-af93-eb458115f75e] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:25:34.162327 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-e1ea5dd5-0366-40f7-b6c7-1e8b74ca0c6b tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:25:34.162327 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-e1ea5dd5-0366-40f7-b6c7-1e8b74ca0c6b tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:25:34.162327 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-e1ea5dd5-0366-40f7-b6c7-1e8b74ca0c6b tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:25:34.162327 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-e1ea5dd5-0366-40f7-b6c7-1e8b74ca0c6b tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:25:34.169906 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG dbcounter [-] [118477] Writing DB stats nova_cell1:SELECT=100 {{(pid=118477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:25:34.193336 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-116e5444-43ca-4f8b-ac59-3d5e0e3cb54a tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e916e4e0fb7140b0912e9233898a0016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd41986c224f414b8768675f40682380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:25:34.202747 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-116e5444-43ca-4f8b-ac59-3d5e0e3cb54a tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] 10.222.0.46 "GET /compute/v2.1/servers/5ad11a1d-cf86-446c-9e0a-db8e16d3fbeb" status: 200 len: 1315 microversion: 2.1 time: 0.217537 Aug 04 05:25:34.203443 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 36/72] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:25:33 2022] GET /compute/v2.1/servers/5ad11a1d-cf86-446c-9e0a-db8e16d3fbeb => generated 1315 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:25:34.314933 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-e6a8ff38-e429-40b0-bef4-2291cda5491f tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:25:34.315452 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-e6a8ff38-e429-40b0-bef4-2291cda5491f tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] [instance: 98f543b7-5432-4a4a-9494-63dac0f733b7] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:25:34.325005 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-e6a8ff38-e429-40b0-bef4-2291cda5491f tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:25:34.328810 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-e6a8ff38-e429-40b0-bef4-2291cda5491f tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:25:34.330233 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-e6a8ff38-e429-40b0-bef4-2291cda5491f tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:25:34.330958 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-e6a8ff38-e429-40b0-bef4-2291cda5491f tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:25:34.355104 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-e1ea5dd5-0366-40f7-b6c7-1e8b74ca0c6b tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb49b631c234f9a9fd47049b9b2e097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faead990837d43de8ec54bfaf24361de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:25:34.363338 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-e1ea5dd5-0366-40f7-b6c7-1e8b74ca0c6b tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] 10.222.0.46 "GET /compute/v2.1/servers/384721d7-1467-45cd-af93-eb458115f75e" status: 200 len: 1366 microversion: 2.1 time: 0.218643 Aug 04 05:25:34.366989 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 37/73] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:25:34 2022] GET /compute/v2.1/servers/384721d7-1467-45cd-af93-eb458115f75e => generated 1366 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:25:34.698902 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-e6a8ff38-e429-40b0-bef4-2291cda5491f tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8f887f5689419e9e31a0ba43f76ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62d19c831574f9b99c993b5e41c645d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:25:34.698902 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-e6a8ff38-e429-40b0-bef4-2291cda5491f tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] 10.222.0.46 "GET /compute/v2.1/servers/98f543b7-5432-4a4a-9494-63dac0f733b7" status: 200 len: 1322 microversion: 2.1 time: 0.378529 Aug 04 05:25:34.698902 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 37/74] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:25:34 2022] GET /compute/v2.1/servers/98f543b7-5432-4a4a-9494-63dac0f733b7 => generated 1322 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:25:35.302107 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-2f314f81-7511-4cd6-ab77-c5d4f7e97d8f tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:25:35.302107 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-2f314f81-7511-4cd6-ab77-c5d4f7e97d8f tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] [instance: 5ad11a1d-cf86-446c-9e0a-db8e16d3fbeb] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:25:35.302107 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-2f314f81-7511-4cd6-ab77-c5d4f7e97d8f tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:25:35.302107 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-2f314f81-7511-4cd6-ab77-c5d4f7e97d8f tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:25:35.303196 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-2f314f81-7511-4cd6-ab77-c5d4f7e97d8f tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:25:35.303196 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-2f314f81-7511-4cd6-ab77-c5d4f7e97d8f tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:25:35.349878 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [req-fb179491-5f57-4bae-8efa-67cfec1aea43 req-295f6551-47d6-4d6a-97ce-15e2aeadcaff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b1a612df-55d1-4106-951d-7f0ea95cfe83", "tag": "7a8650cf-58ba-4122-b8ba-ce2928ab3c9e"}]} {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:25:35.370644 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [req-fb179491-5f57-4bae-8efa-67cfec1aea43 req-295f6551-47d6-4d6a-97ce-15e2aeadcaff service nova] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:25:35.371094 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [req-fb179491-5f57-4bae-8efa-67cfec1aea43 req-295f6551-47d6-4d6a-97ce-15e2aeadcaff service nova] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:25:35.389840 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.compute.server_external_events [req-fb179491-5f57-4bae-8efa-67cfec1aea43 req-295f6551-47d6-4d6a-97ce-15e2aeadcaff service nova] Creating event network-changed:7a8650cf-58ba-4122-b8ba-ce2928ab3c9e for instance b1a612df-55d1-4106-951d-7f0ea95cfe83 on hv-cinder-85207 Aug 04 05:25:35.395461 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [req-fb179491-5f57-4bae-8efa-67cfec1aea43 req-295f6551-47d6-4d6a-97ce-15e2aeadcaff service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050421 Aug 04 05:25:35.396735 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 38/75] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Aug 4 05:25:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:25:35.403231 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-a206724e-cecc-40c8-96ab-972580123d7f tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:25:35.404441 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-a206724e-cecc-40c8-96ab-972580123d7f tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] [instance: 384721d7-1467-45cd-af93-eb458115f75e] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:25:35.413481 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-a206724e-cecc-40c8-96ab-972580123d7f tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:25:35.414060 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-a206724e-cecc-40c8-96ab-972580123d7f tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:25:35.415059 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-a206724e-cecc-40c8-96ab-972580123d7f tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:25:35.415659 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-a206724e-cecc-40c8-96ab-972580123d7f tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:25:35.472304 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-2f314f81-7511-4cd6-ab77-c5d4f7e97d8f tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e916e4e0fb7140b0912e9233898a0016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd41986c224f414b8768675f40682380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:25:35.482699 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-2f314f81-7511-4cd6-ab77-c5d4f7e97d8f tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] 10.222.0.46 "GET /compute/v2.1/servers/5ad11a1d-cf86-446c-9e0a-db8e16d3fbeb" status: 200 len: 1315 microversion: 2.1 time: 0.261166 Aug 04 05:25:35.483291 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 38/76] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:25:35 2022] GET /compute/v2.1/servers/5ad11a1d-cf86-446c-9e0a-db8e16d3fbeb => generated 1315 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 05:25:35.504487 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [req-89adc2d1-6dfe-4132-97ba-f06142813c5f req-85575c63-fc9b-4eff-8d59-3aa4611f5328 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5ad11a1d-cf86-446c-9e0a-db8e16d3fbeb", "tag": "58dd9f97-dfe3-4321-8482-f27443e7ce4c"}]} {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:25:35.522173 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [req-89adc2d1-6dfe-4132-97ba-f06142813c5f req-85575c63-fc9b-4eff-8d59-3aa4611f5328 service nova] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:25:35.522725 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [req-89adc2d1-6dfe-4132-97ba-f06142813c5f req-85575c63-fc9b-4eff-8d59-3aa4611f5328 service nova] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:25:35.541472 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.compute.server_external_events [req-89adc2d1-6dfe-4132-97ba-f06142813c5f req-85575c63-fc9b-4eff-8d59-3aa4611f5328 service nova] Creating event network-changed:58dd9f97-dfe3-4321-8482-f27443e7ce4c for instance 5ad11a1d-cf86-446c-9e0a-db8e16d3fbeb on hv-cinder-85207 Aug 04 05:25:35.549123 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [req-89adc2d1-6dfe-4132-97ba-f06142813c5f req-85575c63-fc9b-4eff-8d59-3aa4611f5328 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064309 Aug 04 05:25:35.550111 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 39/77] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Aug 4 05:25:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:25:35.647218 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-a206724e-cecc-40c8-96ab-972580123d7f tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb49b631c234f9a9fd47049b9b2e097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faead990837d43de8ec54bfaf24361de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:25:35.652159 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG dbcounter [-] [118476] Writing DB stats nova_cell1:SELECT=100 {{(pid=118476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:25:35.659338 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-a206724e-cecc-40c8-96ab-972580123d7f tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] 10.222.0.46 "GET /compute/v2.1/servers/384721d7-1467-45cd-af93-eb458115f75e" status: 200 len: 1366 microversion: 2.1 time: 0.261082 Aug 04 05:25:35.662354 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 39/78] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:25:35 2022] GET /compute/v2.1/servers/384721d7-1467-45cd-af93-eb458115f75e => generated 1366 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:25:35.715771 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-3fd55d24-43ba-45a5-906f-6411f52050d5 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:25:35.716828 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-3fd55d24-43ba-45a5-906f-6411f52050d5 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] [instance: 98f543b7-5432-4a4a-9494-63dac0f733b7] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:25:35.725165 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-3fd55d24-43ba-45a5-906f-6411f52050d5 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:25:35.729690 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-3fd55d24-43ba-45a5-906f-6411f52050d5 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:25:35.729690 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-3fd55d24-43ba-45a5-906f-6411f52050d5 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:25:35.729690 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-3fd55d24-43ba-45a5-906f-6411f52050d5 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:25:36.102710 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-3fd55d24-43ba-45a5-906f-6411f52050d5 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8f887f5689419e9e31a0ba43f76ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62d19c831574f9b99c993b5e41c645d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:25:36.116455 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-3fd55d24-43ba-45a5-906f-6411f52050d5 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] 10.222.0.46 "GET /compute/v2.1/servers/98f543b7-5432-4a4a-9494-63dac0f733b7" status: 200 len: 1322 microversion: 2.1 time: 0.403155 Aug 04 05:25:36.116455 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 40/79] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:25:35 2022] GET /compute/v2.1/servers/98f543b7-5432-4a4a-9494-63dac0f733b7 => generated 1322 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:25:36.507003 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-65b44ce0-d8b8-4b62-ba29-fd57b5220d81 tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:25:36.508846 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-65b44ce0-d8b8-4b62-ba29-fd57b5220d81 tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] [instance: 5ad11a1d-cf86-446c-9e0a-db8e16d3fbeb] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:25:36.526029 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-65b44ce0-d8b8-4b62-ba29-fd57b5220d81 tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:25:36.531618 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-65b44ce0-d8b8-4b62-ba29-fd57b5220d81 tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:25:36.533184 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-65b44ce0-d8b8-4b62-ba29-fd57b5220d81 tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:25:36.534001 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-65b44ce0-d8b8-4b62-ba29-fd57b5220d81 tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:25:36.683412 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-c868186f-bf27-43ec-b780-8c9ff990d5b7 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:25:36.685980 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-c868186f-bf27-43ec-b780-8c9ff990d5b7 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] [instance: 384721d7-1467-45cd-af93-eb458115f75e] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:25:36.716745 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-c868186f-bf27-43ec-b780-8c9ff990d5b7 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:25:36.719904 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-c868186f-bf27-43ec-b780-8c9ff990d5b7 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:25:36.722477 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-c868186f-bf27-43ec-b780-8c9ff990d5b7 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:25:36.732935 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-c868186f-bf27-43ec-b780-8c9ff990d5b7 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:25:37.625580 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-c868186f-bf27-43ec-b780-8c9ff990d5b7 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb49b631c234f9a9fd47049b9b2e097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faead990837d43de8ec54bfaf24361de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:25:37.635023 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-c868186f-bf27-43ec-b780-8c9ff990d5b7 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] 10.222.0.46 "GET /compute/v2.1/servers/384721d7-1467-45cd-af93-eb458115f75e" status: 200 len: 1366 microversion: 2.1 time: 0.956881 Aug 04 05:25:37.637265 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 41/80] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:25:36 2022] GET /compute/v2.1/servers/384721d7-1467-45cd-af93-eb458115f75e => generated 1366 bytes in 960 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 05:25:37.646512 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-894b5470-5867-4d68-8d58-efcc3da3895b tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:25:37.647892 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-894b5470-5867-4d68-8d58-efcc3da3895b tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] [instance: 98f543b7-5432-4a4a-9494-63dac0f733b7] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:25:37.659628 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-894b5470-5867-4d68-8d58-efcc3da3895b tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:25:37.659628 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-894b5470-5867-4d68-8d58-efcc3da3895b tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:25:37.659628 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-894b5470-5867-4d68-8d58-efcc3da3895b tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:25:37.662121 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-894b5470-5867-4d68-8d58-efcc3da3895b tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:25:37.853345 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-65b44ce0-d8b8-4b62-ba29-fd57b5220d81 tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e916e4e0fb7140b0912e9233898a0016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd41986c224f414b8768675f40682380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:25:37.936738 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-65b44ce0-d8b8-4b62-ba29-fd57b5220d81 tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] 10.222.0.46 "GET /compute/v2.1/servers/5ad11a1d-cf86-446c-9e0a-db8e16d3fbeb" status: 200 len: 1315 microversion: 2.1 time: 1.434871 Aug 04 05:25:37.937550 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 40/81] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:25:36 2022] GET /compute/v2.1/servers/5ad11a1d-cf86-446c-9e0a-db8e16d3fbeb => generated 1315 bytes in 1437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:25:38.345372 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-894b5470-5867-4d68-8d58-efcc3da3895b tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8f887f5689419e9e31a0ba43f76ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62d19c831574f9b99c993b5e41c645d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:25:38.377941 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-894b5470-5867-4d68-8d58-efcc3da3895b tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] 10.222.0.46 "GET /compute/v2.1/servers/98f543b7-5432-4a4a-9494-63dac0f733b7" status: 200 len: 1322 microversion: 2.1 time: 0.714902 Aug 04 05:25:38.380329 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 42/82] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:25:37 2022] GET /compute/v2.1/servers/98f543b7-5432-4a4a-9494-63dac0f733b7 => generated 1322 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:25:38.676285 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-ee76463e-e6ce-4c0f-a89a-08f93029642f tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:25:38.681072 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-ee76463e-e6ce-4c0f-a89a-08f93029642f tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] [instance: 384721d7-1467-45cd-af93-eb458115f75e] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:25:38.693070 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG dbcounter [-] [118476] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=6 {{(pid=118476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:25:38.714461 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-ee76463e-e6ce-4c0f-a89a-08f93029642f tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:25:38.715872 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-ee76463e-e6ce-4c0f-a89a-08f93029642f tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:25:38.717959 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-ee76463e-e6ce-4c0f-a89a-08f93029642f tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:25:38.723720 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-ee76463e-e6ce-4c0f-a89a-08f93029642f tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:25:39.004011 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-810b1875-1c43-456e-bff5-08b63e263298 tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:25:39.008163 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-810b1875-1c43-456e-bff5-08b63e263298 tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] [instance: 5ad11a1d-cf86-446c-9e0a-db8e16d3fbeb] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:25:39.033109 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-810b1875-1c43-456e-bff5-08b63e263298 tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:25:39.047108 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-810b1875-1c43-456e-bff5-08b63e263298 tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:25:39.050872 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-810b1875-1c43-456e-bff5-08b63e263298 tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:25:39.054825 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-810b1875-1c43-456e-bff5-08b63e263298 tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:25:39.772595 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-810b1875-1c43-456e-bff5-08b63e263298 tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e916e4e0fb7140b0912e9233898a0016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd41986c224f414b8768675f40682380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:25:39.772595 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-810b1875-1c43-456e-bff5-08b63e263298 tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] 10.222.0.46 "GET /compute/v2.1/servers/5ad11a1d-cf86-446c-9e0a-db8e16d3fbeb" status: 200 len: 1315 microversion: 2.1 time: 0.763112 Aug 04 05:25:39.772595 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 43/83] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:25:38 2022] GET /compute/v2.1/servers/5ad11a1d-cf86-446c-9e0a-db8e16d3fbeb => generated 1315 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:25:39.772595 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-b5f3d2f1-ff62-4836-8123-1397b8f61bb4 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:25:39.773318 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-b5f3d2f1-ff62-4836-8123-1397b8f61bb4 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] [instance: 98f543b7-5432-4a4a-9494-63dac0f733b7] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:25:39.803672 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-b5f3d2f1-ff62-4836-8123-1397b8f61bb4 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:25:39.804026 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-b5f3d2f1-ff62-4836-8123-1397b8f61bb4 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:25:39.805081 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-b5f3d2f1-ff62-4836-8123-1397b8f61bb4 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:25:39.805526 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-b5f3d2f1-ff62-4836-8123-1397b8f61bb4 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:25:39.807033 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-ee76463e-e6ce-4c0f-a89a-08f93029642f tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb49b631c234f9a9fd47049b9b2e097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faead990837d43de8ec54bfaf24361de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:25:39.821604 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-ee76463e-e6ce-4c0f-a89a-08f93029642f tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] 10.222.0.46 "GET /compute/v2.1/servers/384721d7-1467-45cd-af93-eb458115f75e" status: 200 len: 1366 microversion: 2.1 time: 1.160406 Aug 04 05:25:39.823878 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 41/84] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:25:38 2022] GET /compute/v2.1/servers/384721d7-1467-45cd-af93-eb458115f75e => generated 1366 bytes in 1164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:25:40.274081 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-b5f3d2f1-ff62-4836-8123-1397b8f61bb4 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8f887f5689419e9e31a0ba43f76ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62d19c831574f9b99c993b5e41c645d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:25:40.284799 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-b5f3d2f1-ff62-4836-8123-1397b8f61bb4 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] 10.222.0.46 "GET /compute/v2.1/servers/98f543b7-5432-4a4a-9494-63dac0f733b7" status: 200 len: 1322 microversion: 2.1 time: 0.524646 Aug 04 05:25:40.287235 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 44/85] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:25:39 2022] GET /compute/v2.1/servers/98f543b7-5432-4a4a-9494-63dac0f733b7 => generated 1322 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:25:40.784939 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-4b745e9e-665f-420a-80cb-6bf1a07f2f70 tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:25:40.785791 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-4b745e9e-665f-420a-80cb-6bf1a07f2f70 tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] [instance: 5ad11a1d-cf86-446c-9e0a-db8e16d3fbeb] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:25:40.791769 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-4b745e9e-665f-420a-80cb-6bf1a07f2f70 tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:25:40.792502 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-4b745e9e-665f-420a-80cb-6bf1a07f2f70 tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:25:40.793326 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-4b745e9e-665f-420a-80cb-6bf1a07f2f70 tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:25:40.793753 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-4b745e9e-665f-420a-80cb-6bf1a07f2f70 tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:25:40.850499 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-c6dd56c9-937e-4405-8f38-f27e01a53abd tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:25:40.851984 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-c6dd56c9-937e-4405-8f38-f27e01a53abd tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] [instance: 384721d7-1467-45cd-af93-eb458115f75e] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:25:40.859496 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-c6dd56c9-937e-4405-8f38-f27e01a53abd tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:25:40.860297 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-c6dd56c9-937e-4405-8f38-f27e01a53abd tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:25:40.861721 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-c6dd56c9-937e-4405-8f38-f27e01a53abd tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:25:40.862666 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-c6dd56c9-937e-4405-8f38-f27e01a53abd tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:25:41.199687 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-4b745e9e-665f-420a-80cb-6bf1a07f2f70 tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e916e4e0fb7140b0912e9233898a0016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd41986c224f414b8768675f40682380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:25:41.207857 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-4b745e9e-665f-420a-80cb-6bf1a07f2f70 tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] 10.222.0.46 "GET /compute/v2.1/servers/5ad11a1d-cf86-446c-9e0a-db8e16d3fbeb" status: 200 len: 1315 microversion: 2.1 time: 0.427522 Aug 04 05:25:41.221935 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 42/86] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:25:40 2022] GET /compute/v2.1/servers/5ad11a1d-cf86-446c-9e0a-db8e16d3fbeb => generated 1315 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:25:41.263679 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-c6dd56c9-937e-4405-8f38-f27e01a53abd tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb49b631c234f9a9fd47049b9b2e097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faead990837d43de8ec54bfaf24361de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:25:41.272639 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-c6dd56c9-937e-4405-8f38-f27e01a53abd tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] 10.222.0.46 "GET /compute/v2.1/servers/384721d7-1467-45cd-af93-eb458115f75e" status: 200 len: 1366 microversion: 2.1 time: 0.426049 Aug 04 05:25:41.279873 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 45/87] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:25:40 2022] GET /compute/v2.1/servers/384721d7-1467-45cd-af93-eb458115f75e => generated 1366 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:25:41.307628 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-9b752a8c-1d56-4bcb-a0b7-e3840819ed0c tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:25:41.308252 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-9b752a8c-1d56-4bcb-a0b7-e3840819ed0c tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] [instance: 98f543b7-5432-4a4a-9494-63dac0f733b7] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:25:41.318878 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-9b752a8c-1d56-4bcb-a0b7-e3840819ed0c tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:25:41.319193 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-9b752a8c-1d56-4bcb-a0b7-e3840819ed0c tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:25:41.322667 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-9b752a8c-1d56-4bcb-a0b7-e3840819ed0c tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:25:41.323354 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-9b752a8c-1d56-4bcb-a0b7-e3840819ed0c tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:25:41.505885 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-9b752a8c-1d56-4bcb-a0b7-e3840819ed0c tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8f887f5689419e9e31a0ba43f76ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62d19c831574f9b99c993b5e41c645d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:25:41.515495 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-9b752a8c-1d56-4bcb-a0b7-e3840819ed0c tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] 10.222.0.46 "GET /compute/v2.1/servers/98f543b7-5432-4a4a-9494-63dac0f733b7" status: 200 len: 1322 microversion: 2.1 time: 0.211891 Aug 04 05:25:41.516078 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 43/88] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:25:41 2022] GET /compute/v2.1/servers/98f543b7-5432-4a4a-9494-63dac0f733b7 => generated 1322 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:25:42.230814 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-1a55efe7-6569-4bc6-8084-1850ed1925b4 tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:25:42.233341 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-1a55efe7-6569-4bc6-8084-1850ed1925b4 tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] [instance: 5ad11a1d-cf86-446c-9e0a-db8e16d3fbeb] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:25:42.240654 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-1a55efe7-6569-4bc6-8084-1850ed1925b4 tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:25:42.241202 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-1a55efe7-6569-4bc6-8084-1850ed1925b4 tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:25:42.242268 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-1a55efe7-6569-4bc6-8084-1850ed1925b4 tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:25:42.247960 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-1a55efe7-6569-4bc6-8084-1850ed1925b4 tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:25:42.303542 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-0336d6b7-da3a-417f-a4a1-65066799895a tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:25:42.305057 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-0336d6b7-da3a-417f-a4a1-65066799895a tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] [instance: 384721d7-1467-45cd-af93-eb458115f75e] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:25:42.316522 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-0336d6b7-da3a-417f-a4a1-65066799895a tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:25:42.317292 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-0336d6b7-da3a-417f-a4a1-65066799895a tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:25:42.318958 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-0336d6b7-da3a-417f-a4a1-65066799895a tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:25:42.319733 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-0336d6b7-da3a-417f-a4a1-65066799895a tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:25:42.474349 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-1a55efe7-6569-4bc6-8084-1850ed1925b4 tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e916e4e0fb7140b0912e9233898a0016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd41986c224f414b8768675f40682380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:25:42.488875 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-1a55efe7-6569-4bc6-8084-1850ed1925b4 tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] 10.222.0.46 "GET /compute/v2.1/servers/5ad11a1d-cf86-446c-9e0a-db8e16d3fbeb" status: 200 len: 1315 microversion: 2.1 time: 0.262894 Aug 04 05:25:42.489880 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 46/89] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:25:42 2022] GET /compute/v2.1/servers/5ad11a1d-cf86-446c-9e0a-db8e16d3fbeb => generated 1315 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:25:42.544187 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-a852f491-7e3b-4029-aca6-e5c29ce54ebd tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:25:42.544813 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-a852f491-7e3b-4029-aca6-e5c29ce54ebd tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] [instance: 98f543b7-5432-4a4a-9494-63dac0f733b7] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:25:42.561507 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-0336d6b7-da3a-417f-a4a1-65066799895a tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb49b631c234f9a9fd47049b9b2e097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faead990837d43de8ec54bfaf24361de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:25:42.563330 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-a852f491-7e3b-4029-aca6-e5c29ce54ebd tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:25:42.563908 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-a852f491-7e3b-4029-aca6-e5c29ce54ebd tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:25:42.564928 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-a852f491-7e3b-4029-aca6-e5c29ce54ebd tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:25:42.566384 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-a852f491-7e3b-4029-aca6-e5c29ce54ebd tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:25:42.570083 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-0336d6b7-da3a-417f-a4a1-65066799895a tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] 10.222.0.46 "GET /compute/v2.1/servers/384721d7-1467-45cd-af93-eb458115f75e" status: 200 len: 1366 microversion: 2.1 time: 0.273007 Aug 04 05:25:42.574240 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 44/90] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:25:42 2022] GET /compute/v2.1/servers/384721d7-1467-45cd-af93-eb458115f75e => generated 1366 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 05:25:42.734221 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-a852f491-7e3b-4029-aca6-e5c29ce54ebd tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8f887f5689419e9e31a0ba43f76ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62d19c831574f9b99c993b5e41c645d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:25:42.742258 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-a852f491-7e3b-4029-aca6-e5c29ce54ebd tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] 10.222.0.46 "GET /compute/v2.1/servers/98f543b7-5432-4a4a-9494-63dac0f733b7" status: 200 len: 1322 microversion: 2.1 time: 0.202644 Aug 04 05:25:42.742875 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 47/91] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:25:42 2022] GET /compute/v2.1/servers/98f543b7-5432-4a4a-9494-63dac0f733b7 => generated 1322 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 05:25:43.533328 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-4ba2f69f-4ab7-44ae-84cb-c1045a728574 tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:25:43.534217 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-4ba2f69f-4ab7-44ae-84cb-c1045a728574 tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] [instance: 5ad11a1d-cf86-446c-9e0a-db8e16d3fbeb] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:25:43.537599 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG dbcounter [-] [118476] Writing DB stats nova_cell0:SELECT=2 {{(pid=118476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:25:43.542811 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-4ba2f69f-4ab7-44ae-84cb-c1045a728574 tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:25:43.542811 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-4ba2f69f-4ab7-44ae-84cb-c1045a728574 tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:25:43.551242 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-4ba2f69f-4ab7-44ae-84cb-c1045a728574 tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:25:43.552415 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-4ba2f69f-4ab7-44ae-84cb-c1045a728574 tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:25:43.607461 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-af062e21-5184-4907-8f68-475316e933e7 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:25:43.607461 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-af062e21-5184-4907-8f68-475316e933e7 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] [instance: 384721d7-1467-45cd-af93-eb458115f75e] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:25:43.623836 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG dbcounter [-] [118477] Writing DB stats nova_cell0:SELECT=2 {{(pid=118477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:25:43.629364 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-af062e21-5184-4907-8f68-475316e933e7 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:25:43.629913 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-af062e21-5184-4907-8f68-475316e933e7 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:25:43.632510 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-af062e21-5184-4907-8f68-475316e933e7 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:25:43.634663 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-af062e21-5184-4907-8f68-475316e933e7 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:25:44.002074 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-4ba2f69f-4ab7-44ae-84cb-c1045a728574 tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e916e4e0fb7140b0912e9233898a0016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd41986c224f414b8768675f40682380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:25:44.009850 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-4ba2f69f-4ab7-44ae-84cb-c1045a728574 tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] 10.222.0.46 "GET /compute/v2.1/servers/5ad11a1d-cf86-446c-9e0a-db8e16d3fbeb" status: 200 len: 1315 microversion: 2.1 time: 0.501836 Aug 04 05:25:44.011210 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 45/92] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:25:43 2022] GET /compute/v2.1/servers/5ad11a1d-cf86-446c-9e0a-db8e16d3fbeb => generated 1315 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:25:44.016308 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-29d4a1ae-fabf-4e7c-96d8-7a8cb5f18f51 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:25:44.017288 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-29d4a1ae-fabf-4e7c-96d8-7a8cb5f18f51 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] [instance: 98f543b7-5432-4a4a-9494-63dac0f733b7] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:25:44.023923 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-29d4a1ae-fabf-4e7c-96d8-7a8cb5f18f51 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:25:44.024757 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-29d4a1ae-fabf-4e7c-96d8-7a8cb5f18f51 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:25:44.025771 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-29d4a1ae-fabf-4e7c-96d8-7a8cb5f18f51 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:25:44.027097 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-29d4a1ae-fabf-4e7c-96d8-7a8cb5f18f51 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:25:44.063947 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-af062e21-5184-4907-8f68-475316e933e7 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb49b631c234f9a9fd47049b9b2e097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faead990837d43de8ec54bfaf24361de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:25:44.075197 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-af062e21-5184-4907-8f68-475316e933e7 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] 10.222.0.46 "GET /compute/v2.1/servers/384721d7-1467-45cd-af93-eb458115f75e" status: 200 len: 1366 microversion: 2.1 time: 0.483430 Aug 04 05:25:44.081240 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 48/93] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:25:43 2022] GET /compute/v2.1/servers/384721d7-1467-45cd-af93-eb458115f75e => generated 1366 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:25:44.292974 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-29d4a1ae-fabf-4e7c-96d8-7a8cb5f18f51 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8f887f5689419e9e31a0ba43f76ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62d19c831574f9b99c993b5e41c645d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:25:44.299687 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-29d4a1ae-fabf-4e7c-96d8-7a8cb5f18f51 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] 10.222.0.46 "GET /compute/v2.1/servers/98f543b7-5432-4a4a-9494-63dac0f733b7" status: 200 len: 1322 microversion: 2.1 time: 0.287185 Aug 04 05:25:44.300528 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 46/94] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:25:44 2022] GET /compute/v2.1/servers/98f543b7-5432-4a4a-9494-63dac0f733b7 => generated 1322 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:25:45.034861 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-6f9a1234-6b21-4b73-89f1-8f9df59ba8d1 tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:25:45.036559 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-6f9a1234-6b21-4b73-89f1-8f9df59ba8d1 tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] [instance: 5ad11a1d-cf86-446c-9e0a-db8e16d3fbeb] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:25:45.050426 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-6f9a1234-6b21-4b73-89f1-8f9df59ba8d1 tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:25:45.050426 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-6f9a1234-6b21-4b73-89f1-8f9df59ba8d1 tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:25:45.050426 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-6f9a1234-6b21-4b73-89f1-8f9df59ba8d1 tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:25:45.050426 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-6f9a1234-6b21-4b73-89f1-8f9df59ba8d1 tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:25:45.105069 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-4f90f598-0b58-4a3c-92a8-91b0a50572ae tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:25:45.105710 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-4f90f598-0b58-4a3c-92a8-91b0a50572ae tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] [instance: 384721d7-1467-45cd-af93-eb458115f75e] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:25:45.112750 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-4f90f598-0b58-4a3c-92a8-91b0a50572ae tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:25:45.113228 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-4f90f598-0b58-4a3c-92a8-91b0a50572ae tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:25:45.114012 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-4f90f598-0b58-4a3c-92a8-91b0a50572ae tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:25:45.114486 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-4f90f598-0b58-4a3c-92a8-91b0a50572ae tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:25:45.271976 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-6f9a1234-6b21-4b73-89f1-8f9df59ba8d1 tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e916e4e0fb7140b0912e9233898a0016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd41986c224f414b8768675f40682380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:25:45.290774 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-6f9a1234-6b21-4b73-89f1-8f9df59ba8d1 tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] 10.222.0.46 "GET /compute/v2.1/servers/5ad11a1d-cf86-446c-9e0a-db8e16d3fbeb" status: 200 len: 1315 microversion: 2.1 time: 0.251299 Aug 04 05:25:45.290774 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 49/95] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:25:45 2022] GET /compute/v2.1/servers/5ad11a1d-cf86-446c-9e0a-db8e16d3fbeb => generated 1315 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:25:45.321590 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-f71cf301-cde9-4024-a422-51f9f0dcdec9 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:25:45.322277 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-f71cf301-cde9-4024-a422-51f9f0dcdec9 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] [instance: 98f543b7-5432-4a4a-9494-63dac0f733b7] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:25:45.328948 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-f71cf301-cde9-4024-a422-51f9f0dcdec9 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:25:45.329595 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-f71cf301-cde9-4024-a422-51f9f0dcdec9 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:25:45.330440 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-f71cf301-cde9-4024-a422-51f9f0dcdec9 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:25:45.330953 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-f71cf301-cde9-4024-a422-51f9f0dcdec9 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:25:45.355849 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-4f90f598-0b58-4a3c-92a8-91b0a50572ae tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb49b631c234f9a9fd47049b9b2e097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faead990837d43de8ec54bfaf24361de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:25:45.375692 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-4f90f598-0b58-4a3c-92a8-91b0a50572ae tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] 10.222.0.46 "GET /compute/v2.1/servers/384721d7-1467-45cd-af93-eb458115f75e" status: 200 len: 1366 microversion: 2.1 time: 0.272487 Aug 04 05:25:45.376916 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 47/96] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:25:45 2022] GET /compute/v2.1/servers/384721d7-1467-45cd-af93-eb458115f75e => generated 1366 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 05:25:45.588098 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-f71cf301-cde9-4024-a422-51f9f0dcdec9 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8f887f5689419e9e31a0ba43f76ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62d19c831574f9b99c993b5e41c645d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:25:45.595694 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-f71cf301-cde9-4024-a422-51f9f0dcdec9 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] 10.222.0.46 "GET /compute/v2.1/servers/98f543b7-5432-4a4a-9494-63dac0f733b7" status: 200 len: 1322 microversion: 2.1 time: 0.278092 Aug 04 05:25:45.596261 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 50/97] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:25:45 2022] GET /compute/v2.1/servers/98f543b7-5432-4a4a-9494-63dac0f733b7 => generated 1322 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 05:25:46.310775 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-1b169e17-9eb5-48ee-b052-0934c8399d12 tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:25:46.311413 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-1b169e17-9eb5-48ee-b052-0934c8399d12 tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] [instance: 5ad11a1d-cf86-446c-9e0a-db8e16d3fbeb] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:25:46.323796 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-1b169e17-9eb5-48ee-b052-0934c8399d12 tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:25:46.324733 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-1b169e17-9eb5-48ee-b052-0934c8399d12 tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:25:46.326409 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-1b169e17-9eb5-48ee-b052-0934c8399d12 tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:25:46.327274 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-1b169e17-9eb5-48ee-b052-0934c8399d12 tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:25:46.398738 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-8b398b33-a436-47e7-9d1b-29fa7563a820 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:25:46.399616 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-8b398b33-a436-47e7-9d1b-29fa7563a820 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] [instance: 384721d7-1467-45cd-af93-eb458115f75e] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:25:46.414551 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-8b398b33-a436-47e7-9d1b-29fa7563a820 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:25:46.415447 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-8b398b33-a436-47e7-9d1b-29fa7563a820 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:25:46.417642 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-8b398b33-a436-47e7-9d1b-29fa7563a820 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:25:46.425560 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-8b398b33-a436-47e7-9d1b-29fa7563a820 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:25:46.578248 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-1b169e17-9eb5-48ee-b052-0934c8399d12 tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e916e4e0fb7140b0912e9233898a0016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd41986c224f414b8768675f40682380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:25:46.591602 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-1b169e17-9eb5-48ee-b052-0934c8399d12 tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] 10.222.0.46 "GET /compute/v2.1/servers/5ad11a1d-cf86-446c-9e0a-db8e16d3fbeb" status: 200 len: 1315 microversion: 2.1 time: 0.284921 Aug 04 05:25:46.592514 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 48/98] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:25:46 2022] GET /compute/v2.1/servers/5ad11a1d-cf86-446c-9e0a-db8e16d3fbeb => generated 1315 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:25:46.617242 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-75dd0939-7658-41ba-b8ee-0b07c20b8455 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:25:46.617851 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-75dd0939-7658-41ba-b8ee-0b07c20b8455 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] [instance: 98f543b7-5432-4a4a-9494-63dac0f733b7] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:25:46.625576 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-75dd0939-7658-41ba-b8ee-0b07c20b8455 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:25:46.626036 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-75dd0939-7658-41ba-b8ee-0b07c20b8455 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:25:46.626833 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-75dd0939-7658-41ba-b8ee-0b07c20b8455 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:25:46.627530 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-75dd0939-7658-41ba-b8ee-0b07c20b8455 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:25:46.647350 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-8b398b33-a436-47e7-9d1b-29fa7563a820 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb49b631c234f9a9fd47049b9b2e097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faead990837d43de8ec54bfaf24361de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:25:46.659974 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-8b398b33-a436-47e7-9d1b-29fa7563a820 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] 10.222.0.46 "GET /compute/v2.1/servers/384721d7-1467-45cd-af93-eb458115f75e" status: 200 len: 1366 microversion: 2.1 time: 0.265622 Aug 04 05:25:46.662517 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 51/99] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:25:46 2022] GET /compute/v2.1/servers/384721d7-1467-45cd-af93-eb458115f75e => generated 1366 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:25:46.788560 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-75dd0939-7658-41ba-b8ee-0b07c20b8455 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8f887f5689419e9e31a0ba43f76ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62d19c831574f9b99c993b5e41c645d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:25:46.796945 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-75dd0939-7658-41ba-b8ee-0b07c20b8455 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] 10.222.0.46 "GET /compute/v2.1/servers/98f543b7-5432-4a4a-9494-63dac0f733b7" status: 200 len: 1322 microversion: 2.1 time: 0.183624 Aug 04 05:25:46.811225 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 49/100] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:25:46 2022] GET /compute/v2.1/servers/98f543b7-5432-4a4a-9494-63dac0f733b7 => generated 1322 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 05:25:47.615714 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-ebda3ed5-2da0-45df-bf7c-81de472b6422 tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:25:47.616338 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-ebda3ed5-2da0-45df-bf7c-81de472b6422 tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] [instance: 5ad11a1d-cf86-446c-9e0a-db8e16d3fbeb] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:25:47.622498 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-ebda3ed5-2da0-45df-bf7c-81de472b6422 tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:25:47.622946 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-ebda3ed5-2da0-45df-bf7c-81de472b6422 tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:25:47.623714 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-ebda3ed5-2da0-45df-bf7c-81de472b6422 tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:25:47.624145 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-ebda3ed5-2da0-45df-bf7c-81de472b6422 tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:25:47.684440 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-14bdf1d8-e051-4a50-8d04-4e6bcbbcb899 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:25:47.685334 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-14bdf1d8-e051-4a50-8d04-4e6bcbbcb899 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] [instance: 384721d7-1467-45cd-af93-eb458115f75e] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:25:47.692037 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-14bdf1d8-e051-4a50-8d04-4e6bcbbcb899 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:25:47.692570 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-14bdf1d8-e051-4a50-8d04-4e6bcbbcb899 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:25:47.693405 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-14bdf1d8-e051-4a50-8d04-4e6bcbbcb899 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:25:47.693905 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-14bdf1d8-e051-4a50-8d04-4e6bcbbcb899 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:25:47.959536 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-ebda3ed5-2da0-45df-bf7c-81de472b6422 tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e916e4e0fb7140b0912e9233898a0016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd41986c224f414b8768675f40682380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:25:47.977009 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-ebda3ed5-2da0-45df-bf7c-81de472b6422 tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] 10.222.0.46 "GET /compute/v2.1/servers/5ad11a1d-cf86-446c-9e0a-db8e16d3fbeb" status: 200 len: 1315 microversion: 2.1 time: 0.364835 Aug 04 05:25:47.977616 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 52/101] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:25:47 2022] GET /compute/v2.1/servers/5ad11a1d-cf86-446c-9e0a-db8e16d3fbeb => generated 1315 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:25:47.998470 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-bb9a9a0c-06c6-4ac6-b4fb-acb97cc41433 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:25:47.999171 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-bb9a9a0c-06c6-4ac6-b4fb-acb97cc41433 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] [instance: 98f543b7-5432-4a4a-9494-63dac0f733b7] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:25:48.000356 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-14bdf1d8-e051-4a50-8d04-4e6bcbbcb899 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb49b631c234f9a9fd47049b9b2e097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faead990837d43de8ec54bfaf24361de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:25:48.005453 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-bb9a9a0c-06c6-4ac6-b4fb-acb97cc41433 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:25:48.005895 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-bb9a9a0c-06c6-4ac6-b4fb-acb97cc41433 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:25:48.006699 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-bb9a9a0c-06c6-4ac6-b4fb-acb97cc41433 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:25:48.007131 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-bb9a9a0c-06c6-4ac6-b4fb-acb97cc41433 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:25:48.009923 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-14bdf1d8-e051-4a50-8d04-4e6bcbbcb899 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] 10.222.0.46 "GET /compute/v2.1/servers/384721d7-1467-45cd-af93-eb458115f75e" status: 200 len: 1366 microversion: 2.1 time: 0.329372 Aug 04 05:25:48.011340 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 50/102] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:25:47 2022] GET /compute/v2.1/servers/384721d7-1467-45cd-af93-eb458115f75e => generated 1366 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 05:25:48.179423 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-bb9a9a0c-06c6-4ac6-b4fb-acb97cc41433 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8f887f5689419e9e31a0ba43f76ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62d19c831574f9b99c993b5e41c645d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:25:48.188011 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-bb9a9a0c-06c6-4ac6-b4fb-acb97cc41433 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] 10.222.0.46 "GET /compute/v2.1/servers/98f543b7-5432-4a4a-9494-63dac0f733b7" status: 200 len: 1322 microversion: 2.1 time: 0.195395 Aug 04 05:25:48.192982 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 53/103] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:25:47 2022] GET /compute/v2.1/servers/98f543b7-5432-4a4a-9494-63dac0f733b7 => generated 1322 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:25:48.999305 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-88e355ba-44cf-49a7-a759-6cb1c0cf574c tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:25:48.999841 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-88e355ba-44cf-49a7-a759-6cb1c0cf574c tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] [instance: 5ad11a1d-cf86-446c-9e0a-db8e16d3fbeb] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:25:49.005842 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-88e355ba-44cf-49a7-a759-6cb1c0cf574c tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:25:49.006298 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-88e355ba-44cf-49a7-a759-6cb1c0cf574c tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:25:49.007224 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-88e355ba-44cf-49a7-a759-6cb1c0cf574c tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:25:49.007617 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-88e355ba-44cf-49a7-a759-6cb1c0cf574c tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:25:49.032336 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-2c725573-faa0-452c-9a0e-b81a71b750e3 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:25:49.033147 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-2c725573-faa0-452c-9a0e-b81a71b750e3 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] [instance: 384721d7-1467-45cd-af93-eb458115f75e] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:25:49.040071 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-2c725573-faa0-452c-9a0e-b81a71b750e3 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:25:49.040587 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-2c725573-faa0-452c-9a0e-b81a71b750e3 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:25:49.041563 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-2c725573-faa0-452c-9a0e-b81a71b750e3 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:25:49.043210 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-2c725573-faa0-452c-9a0e-b81a71b750e3 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:25:49.063871 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG dbcounter [-] [118477] Writing DB stats nova_cell1:SELECT=100 {{(pid=118477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:25:49.201195 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-88e355ba-44cf-49a7-a759-6cb1c0cf574c tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e916e4e0fb7140b0912e9233898a0016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd41986c224f414b8768675f40682380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:25:49.216817 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-88e355ba-44cf-49a7-a759-6cb1c0cf574c tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] 10.222.0.46 "GET /compute/v2.1/servers/5ad11a1d-cf86-446c-9e0a-db8e16d3fbeb" status: 200 len: 1315 microversion: 2.1 time: 0.221762 Aug 04 05:25:49.217403 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 51/104] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:25:48 2022] GET /compute/v2.1/servers/5ad11a1d-cf86-446c-9e0a-db8e16d3fbeb => generated 1315 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:25:49.222232 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-5c7f4694-d3b5-41a5-921a-5bf32c036ea2 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:25:49.222865 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-5c7f4694-d3b5-41a5-921a-5bf32c036ea2 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] [instance: 98f543b7-5432-4a4a-9494-63dac0f733b7] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:25:49.228703 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-5c7f4694-d3b5-41a5-921a-5bf32c036ea2 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:25:49.230216 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-5c7f4694-d3b5-41a5-921a-5bf32c036ea2 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:25:49.231007 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-5c7f4694-d3b5-41a5-921a-5bf32c036ea2 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:25:49.231636 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-5c7f4694-d3b5-41a5-921a-5bf32c036ea2 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:25:49.241089 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-2c725573-faa0-452c-9a0e-b81a71b750e3 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb49b631c234f9a9fd47049b9b2e097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faead990837d43de8ec54bfaf24361de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:25:49.252584 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-2c725573-faa0-452c-9a0e-b81a71b750e3 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] 10.222.0.46 "GET /compute/v2.1/servers/384721d7-1467-45cd-af93-eb458115f75e" status: 200 len: 1366 microversion: 2.1 time: 0.222901 Aug 04 05:25:49.253335 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 54/105] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:25:49 2022] GET /compute/v2.1/servers/384721d7-1467-45cd-af93-eb458115f75e => generated 1366 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:25:49.421353 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-5c7f4694-d3b5-41a5-921a-5bf32c036ea2 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8f887f5689419e9e31a0ba43f76ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62d19c831574f9b99c993b5e41c645d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:25:49.428944 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-5c7f4694-d3b5-41a5-921a-5bf32c036ea2 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] 10.222.0.46 "GET /compute/v2.1/servers/98f543b7-5432-4a4a-9494-63dac0f733b7" status: 200 len: 1322 microversion: 2.1 time: 0.210296 Aug 04 05:25:49.429742 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 52/106] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:25:49 2022] GET /compute/v2.1/servers/98f543b7-5432-4a4a-9494-63dac0f733b7 => generated 1322 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:25:50.239953 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-d65bafbc-13a5-4a2f-8bf4-f8ab5a8fcb47 tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:25:50.240610 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-d65bafbc-13a5-4a2f-8bf4-f8ab5a8fcb47 tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] [instance: 5ad11a1d-cf86-446c-9e0a-db8e16d3fbeb] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:25:50.248074 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-d65bafbc-13a5-4a2f-8bf4-f8ab5a8fcb47 tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:25:50.248539 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-d65bafbc-13a5-4a2f-8bf4-f8ab5a8fcb47 tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:25:50.249319 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-d65bafbc-13a5-4a2f-8bf4-f8ab5a8fcb47 tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:25:50.249757 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-d65bafbc-13a5-4a2f-8bf4-f8ab5a8fcb47 tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:25:50.283224 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-c8d6df1e-891f-440b-a408-4be2bc8554d9 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:25:50.284705 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-c8d6df1e-891f-440b-a408-4be2bc8554d9 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] [instance: 384721d7-1467-45cd-af93-eb458115f75e] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:25:50.296055 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-c8d6df1e-891f-440b-a408-4be2bc8554d9 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:25:50.300222 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-c8d6df1e-891f-440b-a408-4be2bc8554d9 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:25:50.300222 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-c8d6df1e-891f-440b-a408-4be2bc8554d9 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:25:50.304078 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-c8d6df1e-891f-440b-a408-4be2bc8554d9 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:25:50.701880 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-d65bafbc-13a5-4a2f-8bf4-f8ab5a8fcb47 tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e916e4e0fb7140b0912e9233898a0016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd41986c224f414b8768675f40682380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:25:50.709584 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-d65bafbc-13a5-4a2f-8bf4-f8ab5a8fcb47 tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] 10.222.0.46 "GET /compute/v2.1/servers/5ad11a1d-cf86-446c-9e0a-db8e16d3fbeb" status: 200 len: 1315 microversion: 2.1 time: 0.473733 Aug 04 05:25:50.710152 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 55/107] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:25:50 2022] GET /compute/v2.1/servers/5ad11a1d-cf86-446c-9e0a-db8e16d3fbeb => generated 1315 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:25:50.715691 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-e07a6ba1-0293-404e-97f5-3d3db8d5d3d3 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:25:50.716297 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-e07a6ba1-0293-404e-97f5-3d3db8d5d3d3 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] [instance: 98f543b7-5432-4a4a-9494-63dac0f733b7] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:25:50.722592 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-e07a6ba1-0293-404e-97f5-3d3db8d5d3d3 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:25:50.724223 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-c8d6df1e-891f-440b-a408-4be2bc8554d9 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb49b631c234f9a9fd47049b9b2e097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faead990837d43de8ec54bfaf24361de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:25:50.725431 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-e07a6ba1-0293-404e-97f5-3d3db8d5d3d3 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:25:50.730751 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-e07a6ba1-0293-404e-97f5-3d3db8d5d3d3 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:25:50.731202 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-e07a6ba1-0293-404e-97f5-3d3db8d5d3d3 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:25:50.733037 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-c8d6df1e-891f-440b-a408-4be2bc8554d9 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] 10.222.0.46 "GET /compute/v2.1/servers/384721d7-1467-45cd-af93-eb458115f75e" status: 200 len: 1366 microversion: 2.1 time: 0.453793 Aug 04 05:25:50.733683 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 53/108] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:25:50 2022] GET /compute/v2.1/servers/384721d7-1467-45cd-af93-eb458115f75e => generated 1366 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:25:50.883667 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-e07a6ba1-0293-404e-97f5-3d3db8d5d3d3 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8f887f5689419e9e31a0ba43f76ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62d19c831574f9b99c993b5e41c645d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:25:50.892430 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-e07a6ba1-0293-404e-97f5-3d3db8d5d3d3 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] 10.222.0.46 "GET /compute/v2.1/servers/98f543b7-5432-4a4a-9494-63dac0f733b7" status: 200 len: 1322 microversion: 2.1 time: 0.181239 Aug 04 05:25:50.894351 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 56/109] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:25:50 2022] GET /compute/v2.1/servers/98f543b7-5432-4a4a-9494-63dac0f733b7 => generated 1322 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:25:51.736582 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-a7cc93d2-cac8-4421-893d-cf499875db6b tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:25:51.737773 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-a7cc93d2-cac8-4421-893d-cf499875db6b tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] [instance: 5ad11a1d-cf86-446c-9e0a-db8e16d3fbeb] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:25:51.756873 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-9461625c-ddc7-4807-a197-34b4f41f75d9 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:25:51.757622 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-9461625c-ddc7-4807-a197-34b4f41f75d9 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] [instance: 384721d7-1467-45cd-af93-eb458115f75e] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:25:51.769039 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-a7cc93d2-cac8-4421-893d-cf499875db6b tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:25:51.769630 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-a7cc93d2-cac8-4421-893d-cf499875db6b tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:25:51.771624 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-a7cc93d2-cac8-4421-893d-cf499875db6b tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:25:51.775073 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-a7cc93d2-cac8-4421-893d-cf499875db6b tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:25:51.791610 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-9461625c-ddc7-4807-a197-34b4f41f75d9 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:25:51.791610 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-9461625c-ddc7-4807-a197-34b4f41f75d9 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:25:51.791610 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-9461625c-ddc7-4807-a197-34b4f41f75d9 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:25:51.791610 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-9461625c-ddc7-4807-a197-34b4f41f75d9 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:25:52.091470 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-a7cc93d2-cac8-4421-893d-cf499875db6b tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e916e4e0fb7140b0912e9233898a0016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd41986c224f414b8768675f40682380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:25:52.101130 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-a7cc93d2-cac8-4421-893d-cf499875db6b tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] 10.222.0.46 "GET /compute/v2.1/servers/5ad11a1d-cf86-446c-9e0a-db8e16d3fbeb" status: 200 len: 1315 microversion: 2.1 time: 0.371565 Aug 04 05:25:52.101402 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 54/110] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:25:51 2022] GET /compute/v2.1/servers/5ad11a1d-cf86-446c-9e0a-db8e16d3fbeb => generated 1315 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:25:52.131722 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-e411b54c-f83d-4a16-b290-1d600e66f307 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:25:52.131722 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-e411b54c-f83d-4a16-b290-1d600e66f307 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] [instance: 98f543b7-5432-4a4a-9494-63dac0f733b7] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:25:52.148206 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-e411b54c-f83d-4a16-b290-1d600e66f307 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:25:52.157211 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-e411b54c-f83d-4a16-b290-1d600e66f307 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:25:52.158066 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-e411b54c-f83d-4a16-b290-1d600e66f307 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:25:52.158543 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-e411b54c-f83d-4a16-b290-1d600e66f307 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:25:52.186470 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-9461625c-ddc7-4807-a197-34b4f41f75d9 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb49b631c234f9a9fd47049b9b2e097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faead990837d43de8ec54bfaf24361de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:25:52.197247 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-9461625c-ddc7-4807-a197-34b4f41f75d9 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] 10.222.0.46 "GET /compute/v2.1/servers/384721d7-1467-45cd-af93-eb458115f75e" status: 200 len: 1366 microversion: 2.1 time: 0.445988 Aug 04 05:25:52.198980 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 57/111] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:25:51 2022] GET /compute/v2.1/servers/384721d7-1467-45cd-af93-eb458115f75e => generated 1366 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:25:52.371828 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-e411b54c-f83d-4a16-b290-1d600e66f307 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8f887f5689419e9e31a0ba43f76ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62d19c831574f9b99c993b5e41c645d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:25:52.379420 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-e411b54c-f83d-4a16-b290-1d600e66f307 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] 10.222.0.46 "GET /compute/v2.1/servers/98f543b7-5432-4a4a-9494-63dac0f733b7" status: 200 len: 1322 microversion: 2.1 time: 0.271827 Aug 04 05:25:52.379996 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 55/112] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:25:52 2022] GET /compute/v2.1/servers/98f543b7-5432-4a4a-9494-63dac0f733b7 => generated 1322 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:25:52.557353 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [req-5361ea57-1ec9-47e4-9090-dfe57d6eed88 req-2b842fe7-c9a1-4a94-9c83-acc1834245b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ad11a1d-cf86-446c-9e0a-db8e16d3fbeb", "name": "network-vif-plugged", "status": "completed", "tag": "58dd9f97-dfe3-4321-8482-f27443e7ce4c"}]} {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:25:52.567439 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [req-5361ea57-1ec9-47e4-9090-dfe57d6eed88 req-2b842fe7-c9a1-4a94-9c83-acc1834245b0 service nova] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:25:52.568052 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [req-5361ea57-1ec9-47e4-9090-dfe57d6eed88 req-2b842fe7-c9a1-4a94-9c83-acc1834245b0 service nova] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:25:52.580122 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.compute.server_external_events [req-5361ea57-1ec9-47e4-9090-dfe57d6eed88 req-2b842fe7-c9a1-4a94-9c83-acc1834245b0 service nova] Creating event network-vif-plugged:58dd9f97-dfe3-4321-8482-f27443e7ce4c for instance 5ad11a1d-cf86-446c-9e0a-db8e16d3fbeb on hv-cinder-85207 Aug 04 05:25:52.591439 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [req-5361ea57-1ec9-47e4-9090-dfe57d6eed88 req-2b842fe7-c9a1-4a94-9c83-acc1834245b0 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.178082 Aug 04 05:25:52.592053 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 58/113] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Aug 4 05:25:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:25:53.127604 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-1c09023b-b313-48b8-81fc-f8125f500601 tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:25:53.128208 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-1c09023b-b313-48b8-81fc-f8125f500601 tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] [instance: 5ad11a1d-cf86-446c-9e0a-db8e16d3fbeb] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:25:53.134352 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-1c09023b-b313-48b8-81fc-f8125f500601 tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:25:53.138973 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-1c09023b-b313-48b8-81fc-f8125f500601 tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:25:53.138973 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-1c09023b-b313-48b8-81fc-f8125f500601 tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:25:53.138973 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-1c09023b-b313-48b8-81fc-f8125f500601 tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:25:53.154073 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG dbcounter [-] [118476] Writing DB stats nova_cell1:SELECT=100 {{(pid=118476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:25:53.220486 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-35621f34-bd67-48b0-83e7-c43199626ecd tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:25:53.221763 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-35621f34-bd67-48b0-83e7-c43199626ecd tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] [instance: 384721d7-1467-45cd-af93-eb458115f75e] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:25:53.228719 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-35621f34-bd67-48b0-83e7-c43199626ecd tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:25:53.229219 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-35621f34-bd67-48b0-83e7-c43199626ecd tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:25:53.230643 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-35621f34-bd67-48b0-83e7-c43199626ecd tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:25:53.231272 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-35621f34-bd67-48b0-83e7-c43199626ecd tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:25:53.296930 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-1c09023b-b313-48b8-81fc-f8125f500601 tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e916e4e0fb7140b0912e9233898a0016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd41986c224f414b8768675f40682380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:25:53.305012 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-1c09023b-b313-48b8-81fc-f8125f500601 tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] 10.222.0.46 "GET /compute/v2.1/servers/5ad11a1d-cf86-446c-9e0a-db8e16d3fbeb" status: 200 len: 1315 microversion: 2.1 time: 0.181241 Aug 04 05:25:53.318473 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 56/114] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:25:53 2022] GET /compute/v2.1/servers/5ad11a1d-cf86-446c-9e0a-db8e16d3fbeb => generated 1315 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:25:53.400204 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-7c0b7c34-c423-4cfe-9bbf-fd91203a7c01 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:25:53.401854 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-7c0b7c34-c423-4cfe-9bbf-fd91203a7c01 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] [instance: 98f543b7-5432-4a4a-9494-63dac0f733b7] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:25:53.404354 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-35621f34-bd67-48b0-83e7-c43199626ecd tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb49b631c234f9a9fd47049b9b2e097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faead990837d43de8ec54bfaf24361de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:25:53.410016 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-7c0b7c34-c423-4cfe-9bbf-fd91203a7c01 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:25:53.411420 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-7c0b7c34-c423-4cfe-9bbf-fd91203a7c01 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:25:53.412408 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-7c0b7c34-c423-4cfe-9bbf-fd91203a7c01 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:25:53.412944 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-7c0b7c34-c423-4cfe-9bbf-fd91203a7c01 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:25:53.414044 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-35621f34-bd67-48b0-83e7-c43199626ecd tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] 10.222.0.46 "GET /compute/v2.1/servers/384721d7-1467-45cd-af93-eb458115f75e" status: 200 len: 1366 microversion: 2.1 time: 0.198283 Aug 04 05:25:53.419978 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 59/115] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:25:53 2022] GET /compute/v2.1/servers/384721d7-1467-45cd-af93-eb458115f75e => generated 1366 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 05:25:53.570428 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-7c0b7c34-c423-4cfe-9bbf-fd91203a7c01 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8f887f5689419e9e31a0ba43f76ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62d19c831574f9b99c993b5e41c645d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:25:53.578154 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-7c0b7c34-c423-4cfe-9bbf-fd91203a7c01 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] 10.222.0.46 "GET /compute/v2.1/servers/98f543b7-5432-4a4a-9494-63dac0f733b7" status: 200 len: 1322 microversion: 2.1 time: 0.181705 Aug 04 05:25:53.578793 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 57/116] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:25:53 2022] GET /compute/v2.1/servers/98f543b7-5432-4a4a-9494-63dac0f733b7 => generated 1322 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 05:25:54.329156 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-2bedb897-f0c3-4d8c-b879-85d183a6e02a tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:25:54.331156 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-2bedb897-f0c3-4d8c-b879-85d183a6e02a tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] [instance: 5ad11a1d-cf86-446c-9e0a-db8e16d3fbeb] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:25:54.339612 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-2bedb897-f0c3-4d8c-b879-85d183a6e02a tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:25:54.340390 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-2bedb897-f0c3-4d8c-b879-85d183a6e02a tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:25:54.341429 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-2bedb897-f0c3-4d8c-b879-85d183a6e02a tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:25:54.342024 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-2bedb897-f0c3-4d8c-b879-85d183a6e02a tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:25:54.436432 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-abb2d66d-8f36-437d-931e-13f70fcc4fb4 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:25:54.437051 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-abb2d66d-8f36-437d-931e-13f70fcc4fb4 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] [instance: 384721d7-1467-45cd-af93-eb458115f75e] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:25:54.443860 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-abb2d66d-8f36-437d-931e-13f70fcc4fb4 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:25:54.444308 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-abb2d66d-8f36-437d-931e-13f70fcc4fb4 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:25:54.445323 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-abb2d66d-8f36-437d-931e-13f70fcc4fb4 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:25:54.445973 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-abb2d66d-8f36-437d-931e-13f70fcc4fb4 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:25:54.499292 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-2bedb897-f0c3-4d8c-b879-85d183a6e02a tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e916e4e0fb7140b0912e9233898a0016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd41986c224f414b8768675f40682380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:25:54.510198 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-2bedb897-f0c3-4d8c-b879-85d183a6e02a tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] 10.222.0.46 "GET /compute/v2.1/servers/5ad11a1d-cf86-446c-9e0a-db8e16d3fbeb" status: 200 len: 1315 microversion: 2.1 time: 0.186813 Aug 04 05:25:54.532387 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 60/117] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:25:54 2022] GET /compute/v2.1/servers/5ad11a1d-cf86-446c-9e0a-db8e16d3fbeb => generated 1315 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:25:54.601699 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-0f9815fb-f143-4dc9-9f93-e6794925bb54 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:25:54.602756 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-0f9815fb-f143-4dc9-9f93-e6794925bb54 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] [instance: 98f543b7-5432-4a4a-9494-63dac0f733b7] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:25:54.611524 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-0f9815fb-f143-4dc9-9f93-e6794925bb54 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:25:54.612140 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-0f9815fb-f143-4dc9-9f93-e6794925bb54 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:25:54.613022 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-0f9815fb-f143-4dc9-9f93-e6794925bb54 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:25:54.613557 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-0f9815fb-f143-4dc9-9f93-e6794925bb54 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:25:54.643068 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-abb2d66d-8f36-437d-931e-13f70fcc4fb4 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb49b631c234f9a9fd47049b9b2e097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faead990837d43de8ec54bfaf24361de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:25:54.652066 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-abb2d66d-8f36-437d-931e-13f70fcc4fb4 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] 10.222.0.46 "GET /compute/v2.1/servers/384721d7-1467-45cd-af93-eb458115f75e" status: 200 len: 1366 microversion: 2.1 time: 0.219955 Aug 04 05:25:54.653209 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 58/118] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:25:54 2022] GET /compute/v2.1/servers/384721d7-1467-45cd-af93-eb458115f75e => generated 1366 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:25:54.796983 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-0f9815fb-f143-4dc9-9f93-e6794925bb54 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8f887f5689419e9e31a0ba43f76ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62d19c831574f9b99c993b5e41c645d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:25:54.807117 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-0f9815fb-f143-4dc9-9f93-e6794925bb54 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] 10.222.0.46 "GET /compute/v2.1/servers/98f543b7-5432-4a4a-9494-63dac0f733b7" status: 200 len: 1322 microversion: 2.1 time: 0.210042 Aug 04 05:25:54.808649 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 61/119] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:25:54 2022] GET /compute/v2.1/servers/98f543b7-5432-4a4a-9494-63dac0f733b7 => generated 1322 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 05:25:55.540009 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-f8d0fcdb-4aab-48a7-9d40-fddc3a73f679 tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:25:55.540648 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-f8d0fcdb-4aab-48a7-9d40-fddc3a73f679 tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] [instance: 5ad11a1d-cf86-446c-9e0a-db8e16d3fbeb] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:25:55.549197 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-f8d0fcdb-4aab-48a7-9d40-fddc3a73f679 tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:25:55.549768 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-f8d0fcdb-4aab-48a7-9d40-fddc3a73f679 tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:25:55.550706 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-f8d0fcdb-4aab-48a7-9d40-fddc3a73f679 tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:25:55.551341 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-f8d0fcdb-4aab-48a7-9d40-fddc3a73f679 tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:25:55.677500 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-9a6e56f1-6fad-43ab-ae1b-4eb7ea40fce3 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:25:55.683496 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-9a6e56f1-6fad-43ab-ae1b-4eb7ea40fce3 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] [instance: 384721d7-1467-45cd-af93-eb458115f75e] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:25:55.687373 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-9a6e56f1-6fad-43ab-ae1b-4eb7ea40fce3 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:25:55.688343 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-9a6e56f1-6fad-43ab-ae1b-4eb7ea40fce3 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:25:55.689228 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-9a6e56f1-6fad-43ab-ae1b-4eb7ea40fce3 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:25:55.689978 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-9a6e56f1-6fad-43ab-ae1b-4eb7ea40fce3 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:25:55.802851 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-f8d0fcdb-4aab-48a7-9d40-fddc3a73f679 tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e916e4e0fb7140b0912e9233898a0016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd41986c224f414b8768675f40682380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:25:55.810637 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-f8d0fcdb-4aab-48a7-9d40-fddc3a73f679 tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] 10.222.0.46 "GET /compute/v2.1/servers/5ad11a1d-cf86-446c-9e0a-db8e16d3fbeb" status: 200 len: 1315 microversion: 2.1 time: 0.274506 Aug 04 05:25:55.825358 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 59/120] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:25:55 2022] GET /compute/v2.1/servers/5ad11a1d-cf86-446c-9e0a-db8e16d3fbeb => generated 1315 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:25:55.829415 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [req-302df2c3-c67d-45cf-b68a-6fa855f3975c req-48ea5145-ee55-484c-ab0a-562217565e0a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "384721d7-1467-45cd-af93-eb458115f75e", "name": "network-vif-plugged", "status": "completed", "tag": "7d9439ea-7e8f-45ca-beda-13020209ac61"}]} {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:25:55.853306 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [req-302df2c3-c67d-45cf-b68a-6fa855f3975c req-48ea5145-ee55-484c-ab0a-562217565e0a service nova] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:25:55.853649 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [req-302df2c3-c67d-45cf-b68a-6fa855f3975c req-48ea5145-ee55-484c-ab0a-562217565e0a service nova] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:25:55.869897 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.compute.server_external_events [req-302df2c3-c67d-45cf-b68a-6fa855f3975c req-48ea5145-ee55-484c-ab0a-562217565e0a service nova] Creating event network-vif-plugged:7d9439ea-7e8f-45ca-beda-13020209ac61 for instance 384721d7-1467-45cd-af93-eb458115f75e on hv-cinder-85207 Aug 04 05:25:55.875684 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [req-302df2c3-c67d-45cf-b68a-6fa855f3975c req-48ea5145-ee55-484c-ab0a-562217565e0a service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063141 Aug 04 05:25:55.877240 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 60/121] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Aug 4 05:25:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:25:55.883511 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-0dc98ecc-4e8b-4550-beca-c8ce7f7b9f31 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:25:55.884596 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-0dc98ecc-4e8b-4550-beca-c8ce7f7b9f31 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] [instance: 98f543b7-5432-4a4a-9494-63dac0f733b7] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:25:55.894144 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-0dc98ecc-4e8b-4550-beca-c8ce7f7b9f31 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:25:55.894804 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-0dc98ecc-4e8b-4550-beca-c8ce7f7b9f31 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:25:55.895828 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-0dc98ecc-4e8b-4550-beca-c8ce7f7b9f31 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:25:55.896899 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-0dc98ecc-4e8b-4550-beca-c8ce7f7b9f31 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:25:55.899711 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-9a6e56f1-6fad-43ab-ae1b-4eb7ea40fce3 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb49b631c234f9a9fd47049b9b2e097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faead990837d43de8ec54bfaf24361de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:25:55.918362 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-9a6e56f1-6fad-43ab-ae1b-4eb7ea40fce3 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] 10.222.0.46 "GET /compute/v2.1/servers/384721d7-1467-45cd-af93-eb458115f75e" status: 200 len: 1366 microversion: 2.1 time: 0.239581 Aug 04 05:25:55.918362 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 62/122] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:25:55 2022] GET /compute/v2.1/servers/384721d7-1467-45cd-af93-eb458115f75e => generated 1366 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:25:56.072252 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-0dc98ecc-4e8b-4550-beca-c8ce7f7b9f31 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8f887f5689419e9e31a0ba43f76ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62d19c831574f9b99c993b5e41c645d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:25:56.081428 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-0dc98ecc-4e8b-4550-beca-c8ce7f7b9f31 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] 10.222.0.46 "GET /compute/v2.1/servers/98f543b7-5432-4a4a-9494-63dac0f733b7" status: 200 len: 1322 microversion: 2.1 time: 0.202830 Aug 04 05:25:56.086133 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 61/123] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:25:55 2022] GET /compute/v2.1/servers/98f543b7-5432-4a4a-9494-63dac0f733b7 => generated 1322 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:25:56.832103 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-c8611345-8988-493c-bd85-f2f7b7ede195 tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:25:56.832649 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-c8611345-8988-493c-bd85-f2f7b7ede195 tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] [instance: 5ad11a1d-cf86-446c-9e0a-db8e16d3fbeb] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:25:56.840478 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-c8611345-8988-493c-bd85-f2f7b7ede195 tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:25:56.840926 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-c8611345-8988-493c-bd85-f2f7b7ede195 tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:25:56.841696 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-c8611345-8988-493c-bd85-f2f7b7ede195 tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:25:56.842137 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-c8611345-8988-493c-bd85-f2f7b7ede195 tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:25:56.936860 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-7d9c5e67-9946-4305-b521-53f09d2bf7c9 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:25:56.937465 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-7d9c5e67-9946-4305-b521-53f09d2bf7c9 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] [instance: 384721d7-1467-45cd-af93-eb458115f75e] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:25:56.944130 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-7d9c5e67-9946-4305-b521-53f09d2bf7c9 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:25:56.948977 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-7d9c5e67-9946-4305-b521-53f09d2bf7c9 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:25:56.948977 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-7d9c5e67-9946-4305-b521-53f09d2bf7c9 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:25:56.948977 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-7d9c5e67-9946-4305-b521-53f09d2bf7c9 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:25:56.994114 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-c8611345-8988-493c-bd85-f2f7b7ede195 tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e916e4e0fb7140b0912e9233898a0016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd41986c224f414b8768675f40682380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:25:57.007133 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-c8611345-8988-493c-bd85-f2f7b7ede195 tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] 10.222.0.46 "GET /compute/v2.1/servers/5ad11a1d-cf86-446c-9e0a-db8e16d3fbeb" status: 200 len: 1315 microversion: 2.1 time: 0.178911 Aug 04 05:25:57.007718 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 63/124] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:25:56 2022] GET /compute/v2.1/servers/5ad11a1d-cf86-446c-9e0a-db8e16d3fbeb => generated 1315 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:25:57.092585 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-7d9c5e67-9946-4305-b521-53f09d2bf7c9 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb49b631c234f9a9fd47049b9b2e097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faead990837d43de8ec54bfaf24361de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:25:57.101035 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-7d9c5e67-9946-4305-b521-53f09d2bf7c9 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] 10.222.0.46 "GET /compute/v2.1/servers/384721d7-1467-45cd-af93-eb458115f75e" status: 200 len: 1366 microversion: 2.1 time: 0.168301 Aug 04 05:25:57.101900 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 62/125] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:25:56 2022] GET /compute/v2.1/servers/384721d7-1467-45cd-af93-eb458115f75e => generated 1366 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 05:25:57.103305 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-dac3402d-d50f-4183-a84d-701f3d5ae5d7 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:25:57.103970 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-dac3402d-d50f-4183-a84d-701f3d5ae5d7 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] [instance: 98f543b7-5432-4a4a-9494-63dac0f733b7] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:25:57.111105 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-dac3402d-d50f-4183-a84d-701f3d5ae5d7 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:25:57.111543 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-dac3402d-d50f-4183-a84d-701f3d5ae5d7 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:25:57.112298 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-dac3402d-d50f-4183-a84d-701f3d5ae5d7 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:25:57.112726 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-dac3402d-d50f-4183-a84d-701f3d5ae5d7 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:25:57.271516 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-dac3402d-d50f-4183-a84d-701f3d5ae5d7 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8f887f5689419e9e31a0ba43f76ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62d19c831574f9b99c993b5e41c645d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:25:57.281188 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-dac3402d-d50f-4183-a84d-701f3d5ae5d7 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] 10.222.0.46 "GET /compute/v2.1/servers/98f543b7-5432-4a4a-9494-63dac0f733b7" status: 200 len: 1322 microversion: 2.1 time: 0.181432 Aug 04 05:25:57.282624 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 64/126] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:25:57 2022] GET /compute/v2.1/servers/98f543b7-5432-4a4a-9494-63dac0f733b7 => generated 1322 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 05:25:58.030563 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-cd59ab44-2d0b-4e26-9399-1d0ebe908ba6 tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:25:58.031164 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-cd59ab44-2d0b-4e26-9399-1d0ebe908ba6 tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] [instance: 5ad11a1d-cf86-446c-9e0a-db8e16d3fbeb] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:25:58.037814 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-cd59ab44-2d0b-4e26-9399-1d0ebe908ba6 tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:25:58.038253 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-cd59ab44-2d0b-4e26-9399-1d0ebe908ba6 tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:25:58.039047 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-cd59ab44-2d0b-4e26-9399-1d0ebe908ba6 tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:25:58.039485 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-cd59ab44-2d0b-4e26-9399-1d0ebe908ba6 tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:25:58.125261 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-7f1bcacb-9133-48e3-84d0-ddadba353c5e tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:25:58.125870 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-7f1bcacb-9133-48e3-84d0-ddadba353c5e tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] [instance: 384721d7-1467-45cd-af93-eb458115f75e] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:25:58.132532 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-7f1bcacb-9133-48e3-84d0-ddadba353c5e tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:25:58.132976 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-7f1bcacb-9133-48e3-84d0-ddadba353c5e tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:25:58.133754 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-7f1bcacb-9133-48e3-84d0-ddadba353c5e tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:25:58.134191 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-7f1bcacb-9133-48e3-84d0-ddadba353c5e tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:25:58.243484 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-cd59ab44-2d0b-4e26-9399-1d0ebe908ba6 tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e916e4e0fb7140b0912e9233898a0016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd41986c224f414b8768675f40682380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:25:58.254703 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-cd59ab44-2d0b-4e26-9399-1d0ebe908ba6 tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] 10.222.0.46 "GET /compute/v2.1/servers/5ad11a1d-cf86-446c-9e0a-db8e16d3fbeb" status: 200 len: 1315 microversion: 2.1 time: 0.228777 Aug 04 05:25:58.255927 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 63/127] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:25:58 2022] GET /compute/v2.1/servers/5ad11a1d-cf86-446c-9e0a-db8e16d3fbeb => generated 1315 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:25:58.305848 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-0eea26b0-748f-4789-8363-2ddf9ce69bff tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:25:58.306499 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-0eea26b0-748f-4789-8363-2ddf9ce69bff tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] [instance: 98f543b7-5432-4a4a-9494-63dac0f733b7] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:25:58.316770 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-0eea26b0-748f-4789-8363-2ddf9ce69bff tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:25:58.317730 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-0eea26b0-748f-4789-8363-2ddf9ce69bff tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:25:58.325690 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-0eea26b0-748f-4789-8363-2ddf9ce69bff tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:25:58.329174 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-7f1bcacb-9133-48e3-84d0-ddadba353c5e tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb49b631c234f9a9fd47049b9b2e097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faead990837d43de8ec54bfaf24361de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:25:58.329940 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-0eea26b0-748f-4789-8363-2ddf9ce69bff tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:25:58.339958 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-7f1bcacb-9133-48e3-84d0-ddadba353c5e tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] 10.222.0.46 "GET /compute/v2.1/servers/384721d7-1467-45cd-af93-eb458115f75e" status: 200 len: 1366 microversion: 2.1 time: 0.218503 Aug 04 05:25:58.341587 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 65/128] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:25:58 2022] GET /compute/v2.1/servers/384721d7-1467-45cd-af93-eb458115f75e => generated 1366 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 05:25:58.529438 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-0eea26b0-748f-4789-8363-2ddf9ce69bff tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8f887f5689419e9e31a0ba43f76ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62d19c831574f9b99c993b5e41c645d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:25:58.542924 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-0eea26b0-748f-4789-8363-2ddf9ce69bff tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] 10.222.0.46 "GET /compute/v2.1/servers/98f543b7-5432-4a4a-9494-63dac0f733b7" status: 200 len: 1322 microversion: 2.1 time: 0.240417 Aug 04 05:25:58.546787 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 64/129] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:25:58 2022] GET /compute/v2.1/servers/98f543b7-5432-4a4a-9494-63dac0f733b7 => generated 1322 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 05:25:59.278206 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-e7fff308-68b7-4e58-951c-04a881ac97a6 tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:25:59.279479 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-e7fff308-68b7-4e58-951c-04a881ac97a6 tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] [instance: 5ad11a1d-cf86-446c-9e0a-db8e16d3fbeb] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:25:59.287521 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-e7fff308-68b7-4e58-951c-04a881ac97a6 tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:25:59.288176 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-e7fff308-68b7-4e58-951c-04a881ac97a6 tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:25:59.289112 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-e7fff308-68b7-4e58-951c-04a881ac97a6 tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:25:59.289701 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-e7fff308-68b7-4e58-951c-04a881ac97a6 tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:25:59.375367 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-c8a6e370-7167-41f4-853b-e2ba03feb008 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:25:59.376119 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-c8a6e370-7167-41f4-853b-e2ba03feb008 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] [instance: 384721d7-1467-45cd-af93-eb458115f75e] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:25:59.383162 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-c8a6e370-7167-41f4-853b-e2ba03feb008 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:25:59.383685 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-c8a6e370-7167-41f4-853b-e2ba03feb008 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:25:59.384455 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-c8a6e370-7167-41f4-853b-e2ba03feb008 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:25:59.384885 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-c8a6e370-7167-41f4-853b-e2ba03feb008 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:25:59.507350 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-e7fff308-68b7-4e58-951c-04a881ac97a6 tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e916e4e0fb7140b0912e9233898a0016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd41986c224f414b8768675f40682380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:25:59.522521 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-e7fff308-68b7-4e58-951c-04a881ac97a6 tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] 10.222.0.46 "GET /compute/v2.1/servers/5ad11a1d-cf86-446c-9e0a-db8e16d3fbeb" status: 200 len: 1315 microversion: 2.1 time: 0.247151 Aug 04 05:25:59.542480 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 66/130] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:25:59 2022] GET /compute/v2.1/servers/5ad11a1d-cf86-446c-9e0a-db8e16d3fbeb => generated 1315 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:25:59.571410 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-0550c439-d981-4fee-94ff-e6689831005b tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:25:59.572103 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-0550c439-d981-4fee-94ff-e6689831005b tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] [instance: 98f543b7-5432-4a4a-9494-63dac0f733b7] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:25:59.594626 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-0550c439-d981-4fee-94ff-e6689831005b tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:25:59.594626 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-0550c439-d981-4fee-94ff-e6689831005b tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:25:59.594626 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-0550c439-d981-4fee-94ff-e6689831005b tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:25:59.594626 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-0550c439-d981-4fee-94ff-e6689831005b tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:25:59.718450 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-c8a6e370-7167-41f4-853b-e2ba03feb008 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb49b631c234f9a9fd47049b9b2e097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faead990837d43de8ec54bfaf24361de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:25:59.723121 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-c8a6e370-7167-41f4-853b-e2ba03feb008 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] 10.222.0.46 "GET /compute/v2.1/servers/384721d7-1467-45cd-af93-eb458115f75e" status: 200 len: 1366 microversion: 2.1 time: 0.352093 Aug 04 05:25:59.724225 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 65/131] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:25:59 2022] GET /compute/v2.1/servers/384721d7-1467-45cd-af93-eb458115f75e => generated 1366 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:25:59.829557 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-0550c439-d981-4fee-94ff-e6689831005b tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8f887f5689419e9e31a0ba43f76ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62d19c831574f9b99c993b5e41c645d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:25:59.837043 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-0550c439-d981-4fee-94ff-e6689831005b tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] 10.222.0.46 "GET /compute/v2.1/servers/98f543b7-5432-4a4a-9494-63dac0f733b7" status: 200 len: 1322 microversion: 2.1 time: 0.277038 Aug 04 05:25:59.837568 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 67/132] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:25:59 2022] GET /compute/v2.1/servers/98f543b7-5432-4a4a-9494-63dac0f733b7 => generated 1322 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 05:26:00.268963 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [req-32c6ac1e-5060-49a0-92f1-0f0daf12b133 req-500eff69-ec48-4eaf-a933-d5aff0b3b296 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98f543b7-5432-4a4a-9494-63dac0f733b7", "name": "network-vif-plugged", "status": "completed", "tag": "f35fb18f-8eba-4e19-9262-240ca4bdb983"}]} {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:26:00.282909 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [req-32c6ac1e-5060-49a0-92f1-0f0daf12b133 req-500eff69-ec48-4eaf-a933-d5aff0b3b296 service nova] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:26:00.283609 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [req-32c6ac1e-5060-49a0-92f1-0f0daf12b133 req-500eff69-ec48-4eaf-a933-d5aff0b3b296 service nova] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:26:00.310768 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.compute.server_external_events [req-32c6ac1e-5060-49a0-92f1-0f0daf12b133 req-500eff69-ec48-4eaf-a933-d5aff0b3b296 service nova] Creating event network-vif-plugged:f35fb18f-8eba-4e19-9262-240ca4bdb983 for instance 98f543b7-5432-4a4a-9494-63dac0f733b7 on hv-cinder-85207 Aug 04 05:26:00.317965 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [req-32c6ac1e-5060-49a0-92f1-0f0daf12b133 req-500eff69-ec48-4eaf-a933-d5aff0b3b296 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052824 Aug 04 05:26:00.318930 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 66/133] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Aug 4 05:26:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:26:00.546386 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-ee649de6-92aa-4fb8-83f6-143b28f96d11 tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:26:00.547712 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-ee649de6-92aa-4fb8-83f6-143b28f96d11 tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] [instance: 5ad11a1d-cf86-446c-9e0a-db8e16d3fbeb] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:26:00.566174 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-ee649de6-92aa-4fb8-83f6-143b28f96d11 tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:26:00.566659 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-ee649de6-92aa-4fb8-83f6-143b28f96d11 tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:26:00.567624 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-ee649de6-92aa-4fb8-83f6-143b28f96d11 tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:26:00.568218 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-ee649de6-92aa-4fb8-83f6-143b28f96d11 tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:26:00.733967 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-ee649de6-92aa-4fb8-83f6-143b28f96d11 tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e916e4e0fb7140b0912e9233898a0016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd41986c224f414b8768675f40682380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:26:00.742882 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-ee649de6-92aa-4fb8-83f6-143b28f96d11 tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] 10.222.0.46 "GET /compute/v2.1/servers/5ad11a1d-cf86-446c-9e0a-db8e16d3fbeb" status: 200 len: 1502 microversion: 2.1 time: 0.201340 Aug 04 05:26:00.743466 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 68/134] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:26:00 2022] GET /compute/v2.1/servers/5ad11a1d-cf86-446c-9e0a-db8e16d3fbeb => generated 1502 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 05:26:00.746579 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-b94674bf-3cac-4866-a7f5-1af074bca663 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:26:00.747526 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-b94674bf-3cac-4866-a7f5-1af074bca663 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] [instance: 384721d7-1467-45cd-af93-eb458115f75e] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:26:00.754246 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-b94674bf-3cac-4866-a7f5-1af074bca663 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:26:00.754719 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-b94674bf-3cac-4866-a7f5-1af074bca663 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:26:00.757376 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-b94674bf-3cac-4866-a7f5-1af074bca663 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:26:00.757376 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-b94674bf-3cac-4866-a7f5-1af074bca663 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:26:00.862748 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-ab016c7f-aeb5-4c23-b512-8f2775a5a010 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:26:00.862748 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-ab016c7f-aeb5-4c23-b512-8f2775a5a010 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] [instance: 98f543b7-5432-4a4a-9494-63dac0f733b7] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:26:00.874754 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-ab016c7f-aeb5-4c23-b512-8f2775a5a010 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:26:00.875206 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-ab016c7f-aeb5-4c23-b512-8f2775a5a010 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:26:00.877651 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-ab016c7f-aeb5-4c23-b512-8f2775a5a010 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:26:00.880532 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-ab016c7f-aeb5-4c23-b512-8f2775a5a010 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:26:01.025157 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-b94674bf-3cac-4866-a7f5-1af074bca663 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb49b631c234f9a9fd47049b9b2e097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faead990837d43de8ec54bfaf24361de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:26:01.038891 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-b94674bf-3cac-4866-a7f5-1af074bca663 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] 10.222.0.46 "GET /compute/v2.1/servers/384721d7-1467-45cd-af93-eb458115f75e" status: 200 len: 1366 microversion: 2.1 time: 0.296467 Aug 04 05:26:01.039411 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 67/135] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:26:00 2022] GET /compute/v2.1/servers/384721d7-1467-45cd-af93-eb458115f75e => generated 1366 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 05:26:01.153527 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-ab016c7f-aeb5-4c23-b512-8f2775a5a010 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8f887f5689419e9e31a0ba43f76ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62d19c831574f9b99c993b5e41c645d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:26:01.176902 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-ab016c7f-aeb5-4c23-b512-8f2775a5a010 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] 10.222.0.46 "GET /compute/v2.1/servers/98f543b7-5432-4a4a-9494-63dac0f733b7" status: 200 len: 1322 microversion: 2.1 time: 0.319798 Aug 04 05:26:01.177798 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 69/136] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:26:00 2022] GET /compute/v2.1/servers/98f543b7-5432-4a4a-9494-63dac0f733b7 => generated 1322 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:26:02.065451 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-ec36866e-378d-4eb8-9d19-3573e41840ad tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:26:02.066290 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-ec36866e-378d-4eb8-9d19-3573e41840ad tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] [instance: 384721d7-1467-45cd-af93-eb458115f75e] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:26:02.073179 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-ec36866e-378d-4eb8-9d19-3573e41840ad tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:26:02.074422 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-ec36866e-378d-4eb8-9d19-3573e41840ad tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:26:02.075275 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-ec36866e-378d-4eb8-9d19-3573e41840ad tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:26:02.075770 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-ec36866e-378d-4eb8-9d19-3573e41840ad tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:26:02.200945 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-7e6a2ea4-c3f5-45e2-b179-b577e2b61490 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:26:02.201964 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-7e6a2ea4-c3f5-45e2-b179-b577e2b61490 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] [instance: 98f543b7-5432-4a4a-9494-63dac0f733b7] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:26:02.208529 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-7e6a2ea4-c3f5-45e2-b179-b577e2b61490 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:26:02.208976 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-7e6a2ea4-c3f5-45e2-b179-b577e2b61490 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:26:02.209791 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-7e6a2ea4-c3f5-45e2-b179-b577e2b61490 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:26:02.210420 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-7e6a2ea4-c3f5-45e2-b179-b577e2b61490 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:26:02.231895 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-ec36866e-378d-4eb8-9d19-3573e41840ad tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb49b631c234f9a9fd47049b9b2e097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faead990837d43de8ec54bfaf24361de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:26:02.240792 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-ec36866e-378d-4eb8-9d19-3573e41840ad tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] 10.222.0.46 "GET /compute/v2.1/servers/384721d7-1467-45cd-af93-eb458115f75e" status: 200 len: 1366 microversion: 2.1 time: 0.179310 Aug 04 05:26:02.243248 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 68/137] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:26:02 2022] GET /compute/v2.1/servers/384721d7-1467-45cd-af93-eb458115f75e => generated 1366 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:26:02.334070 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [req-41cb49ec-d667-45af-b617-52cf190bd1e4 req-1a08c444-0144-4570-84f4-53f285593d7e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b1a612df-55d1-4106-951d-7f0ea95cfe83", "name": "network-vif-plugged", "status": "completed", "tag": "7a8650cf-58ba-4122-b8ba-ce2928ab3c9e"}]} {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:26:02.344165 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [req-41cb49ec-d667-45af-b617-52cf190bd1e4 req-1a08c444-0144-4570-84f4-53f285593d7e service nova] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:26:02.344611 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [req-41cb49ec-d667-45af-b617-52cf190bd1e4 req-1a08c444-0144-4570-84f4-53f285593d7e service nova] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:26:02.356109 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.compute.server_external_events [req-41cb49ec-d667-45af-b617-52cf190bd1e4 req-1a08c444-0144-4570-84f4-53f285593d7e service nova] Creating event network-vif-plugged:7a8650cf-58ba-4122-b8ba-ce2928ab3c9e for instance b1a612df-55d1-4106-951d-7f0ea95cfe83 on hv-cinder-85207 Aug 04 05:26:02.360386 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-7e6a2ea4-c3f5-45e2-b179-b577e2b61490 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8f887f5689419e9e31a0ba43f76ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62d19c831574f9b99c993b5e41c645d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:26:02.361368 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [req-41cb49ec-d667-45af-b617-52cf190bd1e4 req-1a08c444-0144-4570-84f4-53f285593d7e service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031076 Aug 04 05:26:02.361987 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 69/138] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Aug 4 05:26:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:26:02.368045 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-7e6a2ea4-c3f5-45e2-b179-b577e2b61490 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] 10.222.0.46 "GET /compute/v2.1/servers/98f543b7-5432-4a4a-9494-63dac0f733b7" status: 200 len: 1322 microversion: 2.1 time: 0.172106 Aug 04 05:26:02.368594 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 70/139] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:26:02 2022] GET /compute/v2.1/servers/98f543b7-5432-4a4a-9494-63dac0f733b7 => generated 1322 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:26:03.263717 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-f1f062fe-75c4-493f-8f65-1f008c238369 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:26:03.264557 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-f1f062fe-75c4-493f-8f65-1f008c238369 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] [instance: 384721d7-1467-45cd-af93-eb458115f75e] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:26:03.271442 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-f1f062fe-75c4-493f-8f65-1f008c238369 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:26:03.271668 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-f1f062fe-75c4-493f-8f65-1f008c238369 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:26:03.272953 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-f1f062fe-75c4-493f-8f65-1f008c238369 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:26:03.273593 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-f1f062fe-75c4-493f-8f65-1f008c238369 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:26:03.390323 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-c4c05621-7cc4-4620-a635-73eaa0b6805e tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:26:03.390996 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-c4c05621-7cc4-4620-a635-73eaa0b6805e tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] [instance: 98f543b7-5432-4a4a-9494-63dac0f733b7] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:26:03.396984 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-c4c05621-7cc4-4620-a635-73eaa0b6805e tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:26:03.402436 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-c4c05621-7cc4-4620-a635-73eaa0b6805e tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:26:03.402436 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-c4c05621-7cc4-4620-a635-73eaa0b6805e tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:26:03.402436 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-c4c05621-7cc4-4620-a635-73eaa0b6805e tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:26:03.431901 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-f1f062fe-75c4-493f-8f65-1f008c238369 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb49b631c234f9a9fd47049b9b2e097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faead990837d43de8ec54bfaf24361de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:26:03.440663 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-f1f062fe-75c4-493f-8f65-1f008c238369 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] 10.222.0.46 "GET /compute/v2.1/servers/384721d7-1467-45cd-af93-eb458115f75e" status: 200 len: 1366 microversion: 2.1 time: 0.182177 Aug 04 05:26:03.441337 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 70/140] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:26:03 2022] GET /compute/v2.1/servers/384721d7-1467-45cd-af93-eb458115f75e => generated 1366 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:26:03.562652 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-c4c05621-7cc4-4620-a635-73eaa0b6805e tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8f887f5689419e9e31a0ba43f76ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62d19c831574f9b99c993b5e41c645d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:26:03.568697 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG dbcounter [-] [118477] Writing DB stats nova_cell1:SELECT=100 {{(pid=118477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:26:03.576176 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-c4c05621-7cc4-4620-a635-73eaa0b6805e tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] 10.222.0.46 "GET /compute/v2.1/servers/98f543b7-5432-4a4a-9494-63dac0f733b7" status: 200 len: 1322 microversion: 2.1 time: 0.190826 Aug 04 05:26:03.586987 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 71/141] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:26:03 2022] GET /compute/v2.1/servers/98f543b7-5432-4a4a-9494-63dac0f733b7 => generated 1322 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:26:04.463712 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-0bebb071-dad4-458a-b633-8da9dfcc7937 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:26:04.465093 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-0bebb071-dad4-458a-b633-8da9dfcc7937 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] [instance: 384721d7-1467-45cd-af93-eb458115f75e] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:26:04.473183 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-0bebb071-dad4-458a-b633-8da9dfcc7937 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:26:04.473183 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-0bebb071-dad4-458a-b633-8da9dfcc7937 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:26:04.473183 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-0bebb071-dad4-458a-b633-8da9dfcc7937 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:26:04.473183 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-0bebb071-dad4-458a-b633-8da9dfcc7937 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:26:04.601144 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-e4dd774d-69e6-440d-a1fe-24763a068778 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:26:04.602960 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-e4dd774d-69e6-440d-a1fe-24763a068778 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] [instance: 98f543b7-5432-4a4a-9494-63dac0f733b7] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:26:04.610134 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG dbcounter [-] [118477] Writing DB stats nova_api:SELECT=78 {{(pid=118477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:26:04.612144 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-e4dd774d-69e6-440d-a1fe-24763a068778 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:26:04.612695 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-e4dd774d-69e6-440d-a1fe-24763a068778 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:26:04.613784 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-e4dd774d-69e6-440d-a1fe-24763a068778 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:26:04.614401 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-e4dd774d-69e6-440d-a1fe-24763a068778 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:26:04.640628 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-0bebb071-dad4-458a-b633-8da9dfcc7937 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb49b631c234f9a9fd47049b9b2e097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faead990837d43de8ec54bfaf24361de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:26:04.647836 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-0bebb071-dad4-458a-b633-8da9dfcc7937 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] 10.222.0.46 "GET /compute/v2.1/servers/384721d7-1467-45cd-af93-eb458115f75e" status: 200 len: 1556 microversion: 2.1 time: 0.189285 Aug 04 05:26:04.648410 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 71/142] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:26:04 2022] GET /compute/v2.1/servers/384721d7-1467-45cd-af93-eb458115f75e => generated 1556 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:26:04.673223 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-fb64cd92-001b-4fef-a2f1-c802203e92eb tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:26:04.673798 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-fb64cd92-001b-4fef-a2f1-c802203e92eb tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] [instance: 384721d7-1467-45cd-af93-eb458115f75e] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:26:04.680832 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-fb64cd92-001b-4fef-a2f1-c802203e92eb tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:26:04.681272 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-fb64cd92-001b-4fef-a2f1-c802203e92eb tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:26:04.683039 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-fb64cd92-001b-4fef-a2f1-c802203e92eb tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:26:04.684373 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-fb64cd92-001b-4fef-a2f1-c802203e92eb tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:26:04.933239 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-fb64cd92-001b-4fef-a2f1-c802203e92eb tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] 10.222.0.46 "GET /compute/v2.1/servers/384721d7-1467-45cd-af93-eb458115f75e/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.263404 Aug 04 05:26:04.934414 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 72/143] 10.222.0.46 () {58 vars in 1275 bytes} [Thu Aug 4 05:26:04 2022] GET /compute/v2.1/servers/384721d7-1467-45cd-af93-eb458115f75e/os-interface => generated 284 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 05:26:04.939527 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-c8187917-fa63-425e-b2e4-aec08a3001ce tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "eb792f1d-72c0-4fb8-8ac4-e98119203a1d"}} {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:26:04.946759 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-c8187917-fa63-425e-b2e4-aec08a3001ce tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] [instance: 5ad11a1d-cf86-446c-9e0a-db8e16d3fbeb] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:26:04.950032 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-c8187917-fa63-425e-b2e4-aec08a3001ce tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:26:04.950511 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-c8187917-fa63-425e-b2e4-aec08a3001ce tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:26:04.951331 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-c8187917-fa63-425e-b2e4-aec08a3001ce tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:26:04.951761 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-c8187917-fa63-425e-b2e4-aec08a3001ce tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:26:05.022175 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-e4dd774d-69e6-440d-a1fe-24763a068778 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8f887f5689419e9e31a0ba43f76ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62d19c831574f9b99c993b5e41c645d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:26:05.045324 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-e4dd774d-69e6-440d-a1fe-24763a068778 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] 10.222.0.46 "GET /compute/v2.1/servers/98f543b7-5432-4a4a-9494-63dac0f733b7" status: 200 len: 1322 microversion: 2.1 time: 0.448162 Aug 04 05:26:05.046206 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 72/144] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:26:04 2022] GET /compute/v2.1/servers/98f543b7-5432-4a4a-9494-63dac0f733b7 => generated 1322 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 05:26:06.083344 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-3d4072de-d2a4-46ef-9d9c-537ba87a0b1b tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:26:06.084026 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-3d4072de-d2a4-46ef-9d9c-537ba87a0b1b tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] [instance: 98f543b7-5432-4a4a-9494-63dac0f733b7] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:26:06.092214 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-3d4072de-d2a4-46ef-9d9c-537ba87a0b1b tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:26:06.093004 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-3d4072de-d2a4-46ef-9d9c-537ba87a0b1b tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:26:06.094552 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-3d4072de-d2a4-46ef-9d9c-537ba87a0b1b tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:26:06.095358 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-3d4072de-d2a4-46ef-9d9c-537ba87a0b1b tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:26:06.277221 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-3d4072de-d2a4-46ef-9d9c-537ba87a0b1b tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8f887f5689419e9e31a0ba43f76ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62d19c831574f9b99c993b5e41c645d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:26:06.286117 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-3d4072de-d2a4-46ef-9d9c-537ba87a0b1b tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] 10.222.0.46 "GET /compute/v2.1/servers/98f543b7-5432-4a4a-9494-63dac0f733b7" status: 200 len: 1322 microversion: 2.1 time: 0.208770 Aug 04 05:26:06.286780 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 73/145] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:26:06 2022] GET /compute/v2.1/servers/98f543b7-5432-4a4a-9494-63dac0f733b7 => generated 1322 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 05:26:06.843935 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [req-cf6a07f1-a3e7-4b6f-80dc-e942bf2aa5b5 req-4631260d-972d-4eef-bd85-5c8345d27dc6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "384721d7-1467-45cd-af93-eb458115f75e", "tag": "7d9439ea-7e8f-45ca-beda-13020209ac61"}]} {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:26:06.859231 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [req-cf6a07f1-a3e7-4b6f-80dc-e942bf2aa5b5 req-4631260d-972d-4eef-bd85-5c8345d27dc6 service nova] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:26:06.860775 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [req-cf6a07f1-a3e7-4b6f-80dc-e942bf2aa5b5 req-4631260d-972d-4eef-bd85-5c8345d27dc6 service nova] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:26:06.888508 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.compute.server_external_events [req-cf6a07f1-a3e7-4b6f-80dc-e942bf2aa5b5 req-4631260d-972d-4eef-bd85-5c8345d27dc6 service nova] Creating event network-changed:7d9439ea-7e8f-45ca-beda-13020209ac61 for instance 384721d7-1467-45cd-af93-eb458115f75e on hv-cinder-85207 Aug 04 05:26:06.896498 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [req-cf6a07f1-a3e7-4b6f-80dc-e942bf2aa5b5 req-4631260d-972d-4eef-bd85-5c8345d27dc6 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058145 Aug 04 05:26:06.897327 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 74/146] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Aug 4 05:26:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:26:07.344442 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-8ea146e8-bbbd-4aec-be14-3e14f8db8407 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:26:07.346478 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-8ea146e8-bbbd-4aec-be14-3e14f8db8407 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] [instance: 98f543b7-5432-4a4a-9494-63dac0f733b7] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:26:07.378198 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-8ea146e8-bbbd-4aec-be14-3e14f8db8407 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:26:07.380334 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-8ea146e8-bbbd-4aec-be14-3e14f8db8407 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:26:07.383024 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-8ea146e8-bbbd-4aec-be14-3e14f8db8407 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:26:07.383734 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-8ea146e8-bbbd-4aec-be14-3e14f8db8407 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:26:07.674750 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-8ea146e8-bbbd-4aec-be14-3e14f8db8407 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8f887f5689419e9e31a0ba43f76ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62d19c831574f9b99c993b5e41c645d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:26:07.689835 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-8ea146e8-bbbd-4aec-be14-3e14f8db8407 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] 10.222.0.46 "GET /compute/v2.1/servers/98f543b7-5432-4a4a-9494-63dac0f733b7" status: 200 len: 1517 microversion: 2.1 time: 0.372244 Aug 04 05:26:07.696117 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 75/147] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:26:07 2022] GET /compute/v2.1/servers/98f543b7-5432-4a4a-9494-63dac0f733b7 => generated 1517 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:26:07.728390 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-f5359c46-92ba-4545-ab57-b568ee985d49 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:26:07.734923 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-f5359c46-92ba-4545-ab57-b568ee985d49 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] [instance: 98f543b7-5432-4a4a-9494-63dac0f733b7] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:26:07.745782 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-f5359c46-92ba-4545-ab57-b568ee985d49 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:26:07.746534 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-f5359c46-92ba-4545-ab57-b568ee985d49 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:26:07.748225 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-f5359c46-92ba-4545-ab57-b568ee985d49 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:26:07.748754 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-f5359c46-92ba-4545-ab57-b568ee985d49 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:26:07.893924 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.objects.instance [None req-f5359c46-92ba-4545-ab57-b568ee985d49 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lazy-loading 'flavor' on Instance uuid 98f543b7-5432-4a4a-9494-63dac0f733b7 {{(pid=118477) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 05:26:08.435510 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-f5359c46-92ba-4545-ab57-b568ee985d49 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] 10.222.0.46 "POST /compute/v2.1/servers/98f543b7-5432-4a4a-9494-63dac0f733b7/action" status: 200 len: 32 microversion: 2.1 time: 0.712442 Aug 04 05:26:08.436608 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 76/148] 10.222.0.46 () {60 vars in 1278 bytes} [Thu Aug 4 05:26:07 2022] POST /compute/v2.1/servers/98f543b7-5432-4a4a-9494-63dac0f733b7/action => generated 32 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 05:26:08.450897 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-b567b9d1-4201-42e3-b321-0fa726e65ac8 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:26:08.454546 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-b567b9d1-4201-42e3-b321-0fa726e65ac8 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] [instance: 98f543b7-5432-4a4a-9494-63dac0f733b7] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:26:08.466421 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-b567b9d1-4201-42e3-b321-0fa726e65ac8 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:26:08.466917 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-b567b9d1-4201-42e3-b321-0fa726e65ac8 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:26:08.467644 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-b567b9d1-4201-42e3-b321-0fa726e65ac8 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:26:08.471768 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-b567b9d1-4201-42e3-b321-0fa726e65ac8 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:26:08.848640 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-c8187917-fa63-425e-b2e4-aec08a3001ce tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] 10.222.0.46 "POST /compute/v2.1/servers/5ad11a1d-cf86-446c-9e0a-db8e16d3fbeb/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.912704 Aug 04 05:26:08.855251 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 73/149] 10.222.0.46 () {60 vars in 1323 bytes} [Thu Aug 4 05:26:04 2022] POST /compute/v2.1/servers/5ad11a1d-cf86-446c-9e0a-db8e16d3fbeb/os-volume_attachments => generated 194 bytes in 3915 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:26:09.114377 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-b567b9d1-4201-42e3-b321-0fa726e65ac8 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8f887f5689419e9e31a0ba43f76ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62d19c831574f9b99c993b5e41c645d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:26:09.127631 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-b567b9d1-4201-42e3-b321-0fa726e65ac8 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] 10.222.0.46 "GET /compute/v2.1/servers/98f543b7-5432-4a4a-9494-63dac0f733b7" status: 200 len: 1523 microversion: 2.1 time: 0.682865 Aug 04 05:26:09.133863 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 77/150] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:26:08 2022] GET /compute/v2.1/servers/98f543b7-5432-4a4a-9494-63dac0f733b7 => generated 1523 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 05:26:10.152216 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-bf080e30-14ca-435b-ab00-757836366ca7 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:26:10.153867 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-bf080e30-14ca-435b-ab00-757836366ca7 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] [instance: 98f543b7-5432-4a4a-9494-63dac0f733b7] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:26:10.176953 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-bf080e30-14ca-435b-ab00-757836366ca7 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:26:10.177473 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-bf080e30-14ca-435b-ab00-757836366ca7 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:26:10.179098 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-bf080e30-14ca-435b-ab00-757836366ca7 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:26:10.179753 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-bf080e30-14ca-435b-ab00-757836366ca7 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:26:10.187378 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG dbcounter [-] [118476] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:26:10.509450 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-bf080e30-14ca-435b-ab00-757836366ca7 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8f887f5689419e9e31a0ba43f76ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62d19c831574f9b99c993b5e41c645d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:26:10.517497 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-bf080e30-14ca-435b-ab00-757836366ca7 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] 10.222.0.46 "GET /compute/v2.1/servers/98f543b7-5432-4a4a-9494-63dac0f733b7" status: 200 len: 1523 microversion: 2.1 time: 0.372330 Aug 04 05:26:10.518368 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 74/151] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:26:10 2022] GET /compute/v2.1/servers/98f543b7-5432-4a4a-9494-63dac0f733b7 => generated 1523 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:26:11.545086 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-270ca37a-b4a9-4452-a6bd-3aee0a26ff2e tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:26:11.548457 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-270ca37a-b4a9-4452-a6bd-3aee0a26ff2e tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] [instance: 98f543b7-5432-4a4a-9494-63dac0f733b7] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:26:11.561846 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-270ca37a-b4a9-4452-a6bd-3aee0a26ff2e tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:26:11.562689 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-270ca37a-b4a9-4452-a6bd-3aee0a26ff2e tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:26:11.564888 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-270ca37a-b4a9-4452-a6bd-3aee0a26ff2e tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:26:11.565649 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-270ca37a-b4a9-4452-a6bd-3aee0a26ff2e tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:26:11.791172 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-270ca37a-b4a9-4452-a6bd-3aee0a26ff2e tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8f887f5689419e9e31a0ba43f76ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62d19c831574f9b99c993b5e41c645d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:26:11.801396 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-270ca37a-b4a9-4452-a6bd-3aee0a26ff2e tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] 10.222.0.46 "GET /compute/v2.1/servers/98f543b7-5432-4a4a-9494-63dac0f733b7" status: 200 len: 1523 microversion: 2.1 time: 0.264869 Aug 04 05:26:11.801991 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 78/152] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:26:11 2022] GET /compute/v2.1/servers/98f543b7-5432-4a4a-9494-63dac0f733b7 => generated 1523 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:26:12.824589 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-89285d01-3082-435c-8050-596aa5bbd80d tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:26:12.825330 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-89285d01-3082-435c-8050-596aa5bbd80d tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] [instance: 98f543b7-5432-4a4a-9494-63dac0f733b7] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:26:12.828716 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG dbcounter [-] [118476] Writing DB stats nova_api:SELECT=68 {{(pid=118476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:26:12.841699 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-89285d01-3082-435c-8050-596aa5bbd80d tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:26:12.842244 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-89285d01-3082-435c-8050-596aa5bbd80d tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:26:12.843348 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-89285d01-3082-435c-8050-596aa5bbd80d tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:26:12.845222 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-89285d01-3082-435c-8050-596aa5bbd80d tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:26:13.219999 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-89285d01-3082-435c-8050-596aa5bbd80d tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8f887f5689419e9e31a0ba43f76ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62d19c831574f9b99c993b5e41c645d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:26:13.234268 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-89285d01-3082-435c-8050-596aa5bbd80d tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] 10.222.0.46 "GET /compute/v2.1/servers/98f543b7-5432-4a4a-9494-63dac0f733b7" status: 200 len: 1523 microversion: 2.1 time: 0.414994 Aug 04 05:26:13.235986 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 75/153] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:26:12 2022] GET /compute/v2.1/servers/98f543b7-5432-4a4a-9494-63dac0f733b7 => generated 1523 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:26:14.261323 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-8e05a4b5-2808-4b86-9713-ced2042ff5ac tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:26:14.263615 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-8e05a4b5-2808-4b86-9713-ced2042ff5ac tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] [instance: 98f543b7-5432-4a4a-9494-63dac0f733b7] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:26:14.274570 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-8e05a4b5-2808-4b86-9713-ced2042ff5ac tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:26:14.275391 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-8e05a4b5-2808-4b86-9713-ced2042ff5ac tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:26:14.276923 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-8e05a4b5-2808-4b86-9713-ced2042ff5ac tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:26:14.277938 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-8e05a4b5-2808-4b86-9713-ced2042ff5ac tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:26:14.474827 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-8e05a4b5-2808-4b86-9713-ced2042ff5ac tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8f887f5689419e9e31a0ba43f76ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62d19c831574f9b99c993b5e41c645d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:26:14.484422 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-8e05a4b5-2808-4b86-9713-ced2042ff5ac tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] 10.222.0.46 "GET /compute/v2.1/servers/98f543b7-5432-4a4a-9494-63dac0f733b7" status: 200 len: 1523 microversion: 2.1 time: 0.230966 Aug 04 05:26:14.485208 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 79/154] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:26:14 2022] GET /compute/v2.1/servers/98f543b7-5432-4a4a-9494-63dac0f733b7 => generated 1523 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:26:15.512951 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-17b1902b-077e-4d58-ac96-03d439c20335 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:26:15.512951 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-17b1902b-077e-4d58-ac96-03d439c20335 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] [instance: 98f543b7-5432-4a4a-9494-63dac0f733b7] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:26:15.516151 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-17b1902b-077e-4d58-ac96-03d439c20335 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:26:15.516701 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-17b1902b-077e-4d58-ac96-03d439c20335 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:26:15.517577 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-17b1902b-077e-4d58-ac96-03d439c20335 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:26:15.518086 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-17b1902b-077e-4d58-ac96-03d439c20335 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:26:15.688121 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-17b1902b-077e-4d58-ac96-03d439c20335 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8f887f5689419e9e31a0ba43f76ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62d19c831574f9b99c993b5e41c645d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:26:15.698014 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-17b1902b-077e-4d58-ac96-03d439c20335 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] 10.222.0.46 "GET /compute/v2.1/servers/98f543b7-5432-4a4a-9494-63dac0f733b7" status: 200 len: 1523 microversion: 2.1 time: 0.194905 Aug 04 05:26:15.703772 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 76/155] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:26:15 2022] GET /compute/v2.1/servers/98f543b7-5432-4a4a-9494-63dac0f733b7 => generated 1523 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:26:16.722233 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-49d44bb4-2129-40c5-be86-fd34dee7042b tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:26:16.723214 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-49d44bb4-2129-40c5-be86-fd34dee7042b tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] [instance: 98f543b7-5432-4a4a-9494-63dac0f733b7] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:26:16.732990 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-49d44bb4-2129-40c5-be86-fd34dee7042b tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:26:16.733787 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-49d44bb4-2129-40c5-be86-fd34dee7042b tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:26:16.735218 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-49d44bb4-2129-40c5-be86-fd34dee7042b tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:26:16.736057 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-49d44bb4-2129-40c5-be86-fd34dee7042b tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:26:17.003514 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-49d44bb4-2129-40c5-be86-fd34dee7042b tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8f887f5689419e9e31a0ba43f76ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62d19c831574f9b99c993b5e41c645d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:26:17.013434 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-49d44bb4-2129-40c5-be86-fd34dee7042b tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] 10.222.0.46 "GET /compute/v2.1/servers/98f543b7-5432-4a4a-9494-63dac0f733b7" status: 200 len: 1523 microversion: 2.1 time: 0.296891 Aug 04 05:26:17.014228 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 80/156] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:26:16 2022] GET /compute/v2.1/servers/98f543b7-5432-4a4a-9494-63dac0f733b7 => generated 1523 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:26:18.036436 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-1c1ae58a-b9a6-41a4-8166-6fc5ffcf7587 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:26:18.041322 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-1c1ae58a-b9a6-41a4-8166-6fc5ffcf7587 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] [instance: 98f543b7-5432-4a4a-9494-63dac0f733b7] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:26:18.044357 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-1c1ae58a-b9a6-41a4-8166-6fc5ffcf7587 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:26:18.044750 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-1c1ae58a-b9a6-41a4-8166-6fc5ffcf7587 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:26:18.045531 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-1c1ae58a-b9a6-41a4-8166-6fc5ffcf7587 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:26:18.045967 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-1c1ae58a-b9a6-41a4-8166-6fc5ffcf7587 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:26:18.266231 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-1c1ae58a-b9a6-41a4-8166-6fc5ffcf7587 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8f887f5689419e9e31a0ba43f76ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62d19c831574f9b99c993b5e41c645d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:26:18.275606 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-1c1ae58a-b9a6-41a4-8166-6fc5ffcf7587 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] 10.222.0.46 "GET /compute/v2.1/servers/98f543b7-5432-4a4a-9494-63dac0f733b7" status: 200 len: 1523 microversion: 2.1 time: 0.243388 Aug 04 05:26:18.277238 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 77/157] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:26:18 2022] GET /compute/v2.1/servers/98f543b7-5432-4a4a-9494-63dac0f733b7 => generated 1523 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:26:19.302490 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-e124e76b-63ac-434e-9be8-3d11aa17a144 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:26:19.303107 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-e124e76b-63ac-434e-9be8-3d11aa17a144 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] [instance: 98f543b7-5432-4a4a-9494-63dac0f733b7] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:26:19.310012 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-e124e76b-63ac-434e-9be8-3d11aa17a144 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:26:19.310528 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-e124e76b-63ac-434e-9be8-3d11aa17a144 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:26:19.311303 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-e124e76b-63ac-434e-9be8-3d11aa17a144 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:26:19.311741 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-e124e76b-63ac-434e-9be8-3d11aa17a144 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:26:19.631898 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-e124e76b-63ac-434e-9be8-3d11aa17a144 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8f887f5689419e9e31a0ba43f76ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62d19c831574f9b99c993b5e41c645d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:26:19.640467 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-e124e76b-63ac-434e-9be8-3d11aa17a144 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] 10.222.0.46 "GET /compute/v2.1/servers/98f543b7-5432-4a4a-9494-63dac0f733b7" status: 200 len: 1523 microversion: 2.1 time: 0.342260 Aug 04 05:26:19.641050 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 81/158] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:26:19 2022] GET /compute/v2.1/servers/98f543b7-5432-4a4a-9494-63dac0f733b7 => generated 1523 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 05:26:20.509327 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-947972ac-11d0-47aa-a388-d3fb63a08966 tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:26:20.510574 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-947972ac-11d0-47aa-a388-d3fb63a08966 tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] [instance: 5ad11a1d-cf86-446c-9e0a-db8e16d3fbeb] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:26:20.532107 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-947972ac-11d0-47aa-a388-d3fb63a08966 tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:26:20.532568 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-947972ac-11d0-47aa-a388-d3fb63a08966 tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:26:20.533353 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-947972ac-11d0-47aa-a388-d3fb63a08966 tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:26:20.533793 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-947972ac-11d0-47aa-a388-d3fb63a08966 tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:26:20.579736 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-947972ac-11d0-47aa-a388-d3fb63a08966 tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] [instance: 5ad11a1d-cf86-446c-9e0a-db8e16d3fbeb] Going to try to terminate instance {{(pid=118476) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 05:26:20.681923 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-69e195ad-3e11-45d2-84a0-a3bf1381d71f tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:26:20.681923 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-69e195ad-3e11-45d2-84a0-a3bf1381d71f tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] [instance: 98f543b7-5432-4a4a-9494-63dac0f733b7] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:26:20.681923 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-69e195ad-3e11-45d2-84a0-a3bf1381d71f tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:26:20.683070 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-69e195ad-3e11-45d2-84a0-a3bf1381d71f tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:26:20.683291 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-69e195ad-3e11-45d2-84a0-a3bf1381d71f tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:26:20.683867 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-69e195ad-3e11-45d2-84a0-a3bf1381d71f tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:26:20.949715 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-69e195ad-3e11-45d2-84a0-a3bf1381d71f tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8f887f5689419e9e31a0ba43f76ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62d19c831574f9b99c993b5e41c645d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:26:20.975037 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-69e195ad-3e11-45d2-84a0-a3bf1381d71f tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] 10.222.0.46 "GET /compute/v2.1/servers/98f543b7-5432-4a4a-9494-63dac0f733b7" status: 200 len: 1523 microversion: 2.1 time: 0.289278 Aug 04 05:26:20.975037 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 82/159] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:26:20 2022] GET /compute/v2.1/servers/98f543b7-5432-4a4a-9494-63dac0f733b7 => generated 1523 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:26:21.082165 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-947972ac-11d0-47aa-a388-d3fb63a08966 tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] 10.222.0.46 "DELETE /compute/v2.1/servers/5ad11a1d-cf86-446c-9e0a-db8e16d3fbeb" status: 204 len: 0 microversion: 2.1 time: 0.591491 Aug 04 05:26:21.083017 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 78/160] 10.222.0.46 () {58 vars in 1239 bytes} [Thu Aug 4 05:26:20 2022] DELETE /compute/v2.1/servers/5ad11a1d-cf86-446c-9e0a-db8e16d3fbeb => generated 0 bytes in 594 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 04 05:26:21.091975 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-c0e8ff0a-9bd0-4684-924a-f89df0cad55b tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:26:21.092596 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-c0e8ff0a-9bd0-4684-924a-f89df0cad55b tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] [instance: 5ad11a1d-cf86-446c-9e0a-db8e16d3fbeb] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:26:21.101919 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-c0e8ff0a-9bd0-4684-924a-f89df0cad55b tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:26:21.101919 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-c0e8ff0a-9bd0-4684-924a-f89df0cad55b tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:26:21.101919 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-c0e8ff0a-9bd0-4684-924a-f89df0cad55b tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:26:21.102243 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-c0e8ff0a-9bd0-4684-924a-f89df0cad55b tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:26:21.300056 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-c0e8ff0a-9bd0-4684-924a-f89df0cad55b tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e916e4e0fb7140b0912e9233898a0016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd41986c224f414b8768675f40682380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:26:21.316783 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-c0e8ff0a-9bd0-4684-924a-f89df0cad55b tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] 10.222.0.46 "GET /compute/v2.1/servers/5ad11a1d-cf86-446c-9e0a-db8e16d3fbeb" status: 200 len: 1554 microversion: 2.1 time: 0.228619 Aug 04 05:26:21.324423 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 83/161] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:26:21 2022] GET /compute/v2.1/servers/5ad11a1d-cf86-446c-9e0a-db8e16d3fbeb => generated 1554 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:26:21.985648 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-3725dac1-9db9-4342-9d84-54665b8951ad tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:26:21.986549 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-3725dac1-9db9-4342-9d84-54665b8951ad tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] [instance: 98f543b7-5432-4a4a-9494-63dac0f733b7] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:26:21.994147 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-3725dac1-9db9-4342-9d84-54665b8951ad tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:26:21.995350 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-3725dac1-9db9-4342-9d84-54665b8951ad tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:26:21.996438 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-3725dac1-9db9-4342-9d84-54665b8951ad tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:26:21.997168 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-3725dac1-9db9-4342-9d84-54665b8951ad tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:26:22.168606 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-3725dac1-9db9-4342-9d84-54665b8951ad tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8f887f5689419e9e31a0ba43f76ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62d19c831574f9b99c993b5e41c645d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:26:22.178365 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-3725dac1-9db9-4342-9d84-54665b8951ad tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] 10.222.0.46 "GET /compute/v2.1/servers/98f543b7-5432-4a4a-9494-63dac0f733b7" status: 200 len: 1523 microversion: 2.1 time: 0.199266 Aug 04 05:26:22.187502 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 79/162] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:26:21 2022] GET /compute/v2.1/servers/98f543b7-5432-4a4a-9494-63dac0f733b7 => generated 1523 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:26:22.341169 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-0b961587-4861-4904-887a-e6d2495f274f tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:26:22.341872 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-0b961587-4861-4904-887a-e6d2495f274f tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] [instance: 5ad11a1d-cf86-446c-9e0a-db8e16d3fbeb] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:26:22.348093 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-0b961587-4861-4904-887a-e6d2495f274f tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:26:22.348627 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-0b961587-4861-4904-887a-e6d2495f274f tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:26:22.349496 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-0b961587-4861-4904-887a-e6d2495f274f tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:26:22.350006 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-0b961587-4861-4904-887a-e6d2495f274f tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:26:22.513665 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-0b961587-4861-4904-887a-e6d2495f274f tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e916e4e0fb7140b0912e9233898a0016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd41986c224f414b8768675f40682380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:26:22.522072 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-0b961587-4861-4904-887a-e6d2495f274f tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] 10.222.0.46 "GET /compute/v2.1/servers/5ad11a1d-cf86-446c-9e0a-db8e16d3fbeb" status: 200 len: 1554 microversion: 2.1 time: 0.185847 Aug 04 05:26:22.523387 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 84/163] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:26:22 2022] GET /compute/v2.1/servers/5ad11a1d-cf86-446c-9e0a-db8e16d3fbeb => generated 1554 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:26:23.202805 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-45fdd745-763c-4390-a0bc-4f0128e394c2 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:26:23.203616 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-45fdd745-763c-4390-a0bc-4f0128e394c2 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] [instance: 98f543b7-5432-4a4a-9494-63dac0f733b7] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:26:23.211547 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-45fdd745-763c-4390-a0bc-4f0128e394c2 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:26:23.212090 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-45fdd745-763c-4390-a0bc-4f0128e394c2 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:26:23.212927 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-45fdd745-763c-4390-a0bc-4f0128e394c2 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:26:23.213587 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-45fdd745-763c-4390-a0bc-4f0128e394c2 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:26:23.411827 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-45fdd745-763c-4390-a0bc-4f0128e394c2 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8f887f5689419e9e31a0ba43f76ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62d19c831574f9b99c993b5e41c645d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:26:23.422933 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-45fdd745-763c-4390-a0bc-4f0128e394c2 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] 10.222.0.46 "GET /compute/v2.1/servers/98f543b7-5432-4a4a-9494-63dac0f733b7" status: 200 len: 1523 microversion: 2.1 time: 0.225291 Aug 04 05:26:23.423810 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 80/164] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:26:23 2022] GET /compute/v2.1/servers/98f543b7-5432-4a4a-9494-63dac0f733b7 => generated 1523 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:26:23.549783 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-4cc905c6-6b06-432e-8af6-d7cd7700c0c4 tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:26:23.551199 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-4cc905c6-6b06-432e-8af6-d7cd7700c0c4 tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] [instance: 5ad11a1d-cf86-446c-9e0a-db8e16d3fbeb] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:26:23.563219 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-4cc905c6-6b06-432e-8af6-d7cd7700c0c4 tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:26:23.563663 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-4cc905c6-6b06-432e-8af6-d7cd7700c0c4 tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:26:23.565280 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-4cc905c6-6b06-432e-8af6-d7cd7700c0c4 tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:26:23.566081 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-4cc905c6-6b06-432e-8af6-d7cd7700c0c4 tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:26:23.760885 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-4cc905c6-6b06-432e-8af6-d7cd7700c0c4 tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e916e4e0fb7140b0912e9233898a0016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd41986c224f414b8768675f40682380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:26:23.768741 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-4cc905c6-6b06-432e-8af6-d7cd7700c0c4 tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] 10.222.0.46 "GET /compute/v2.1/servers/5ad11a1d-cf86-446c-9e0a-db8e16d3fbeb" status: 200 len: 1554 microversion: 2.1 time: 0.227144 Aug 04 05:26:23.769313 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 85/165] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:26:23 2022] GET /compute/v2.1/servers/5ad11a1d-cf86-446c-9e0a-db8e16d3fbeb => generated 1554 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 05:26:24.450058 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-f1edc1fb-6930-4d83-ab58-dbc6b4dd2a1d tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:26:24.450058 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-f1edc1fb-6930-4d83-ab58-dbc6b4dd2a1d tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] [instance: 98f543b7-5432-4a4a-9494-63dac0f733b7] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:26:24.455407 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-f1edc1fb-6930-4d83-ab58-dbc6b4dd2a1d tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:26:24.455907 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-f1edc1fb-6930-4d83-ab58-dbc6b4dd2a1d tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:26:24.456681 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-f1edc1fb-6930-4d83-ab58-dbc6b4dd2a1d tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:26:24.457109 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-f1edc1fb-6930-4d83-ab58-dbc6b4dd2a1d tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:26:24.632160 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-f1edc1fb-6930-4d83-ab58-dbc6b4dd2a1d tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8f887f5689419e9e31a0ba43f76ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62d19c831574f9b99c993b5e41c645d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:26:24.647045 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-f1edc1fb-6930-4d83-ab58-dbc6b4dd2a1d tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] 10.222.0.46 "GET /compute/v2.1/servers/98f543b7-5432-4a4a-9494-63dac0f733b7" status: 200 len: 1523 microversion: 2.1 time: 0.204600 Aug 04 05:26:24.648122 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 81/166] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:26:24 2022] GET /compute/v2.1/servers/98f543b7-5432-4a4a-9494-63dac0f733b7 => generated 1523 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 05:26:24.801740 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-030324d8-289e-4e5c-bbbe-a3989351aea6 tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:26:24.810410 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-030324d8-289e-4e5c-bbbe-a3989351aea6 tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] [instance: 5ad11a1d-cf86-446c-9e0a-db8e16d3fbeb] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:26:24.833474 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-030324d8-289e-4e5c-bbbe-a3989351aea6 tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:26:24.834132 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-030324d8-289e-4e5c-bbbe-a3989351aea6 tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:26:24.835708 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-030324d8-289e-4e5c-bbbe-a3989351aea6 tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:26:24.836651 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-030324d8-289e-4e5c-bbbe-a3989351aea6 tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:26:25.084162 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-030324d8-289e-4e5c-bbbe-a3989351aea6 tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e916e4e0fb7140b0912e9233898a0016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd41986c224f414b8768675f40682380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:26:25.094349 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-030324d8-289e-4e5c-bbbe-a3989351aea6 tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] 10.222.0.46 "GET /compute/v2.1/servers/5ad11a1d-cf86-446c-9e0a-db8e16d3fbeb" status: 200 len: 1554 microversion: 2.1 time: 0.302452 Aug 04 05:26:25.095319 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 86/167] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:26:24 2022] GET /compute/v2.1/servers/5ad11a1d-cf86-446c-9e0a-db8e16d3fbeb => generated 1554 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:26:25.683324 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-ad38ba61-c29c-4858-80c0-14da9b958711 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:26:25.683928 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-ad38ba61-c29c-4858-80c0-14da9b958711 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] [instance: 98f543b7-5432-4a4a-9494-63dac0f733b7] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:26:25.691459 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-ad38ba61-c29c-4858-80c0-14da9b958711 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:26:25.692055 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-ad38ba61-c29c-4858-80c0-14da9b958711 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:26:25.692886 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-ad38ba61-c29c-4858-80c0-14da9b958711 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:26:25.693402 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-ad38ba61-c29c-4858-80c0-14da9b958711 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:26:25.866438 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-ad38ba61-c29c-4858-80c0-14da9b958711 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8f887f5689419e9e31a0ba43f76ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62d19c831574f9b99c993b5e41c645d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:26:25.876854 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-ad38ba61-c29c-4858-80c0-14da9b958711 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] 10.222.0.46 "GET /compute/v2.1/servers/98f543b7-5432-4a4a-9494-63dac0f733b7" status: 200 len: 1523 microversion: 2.1 time: 0.197642 Aug 04 05:26:25.877529 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 82/168] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:26:25 2022] GET /compute/v2.1/servers/98f543b7-5432-4a4a-9494-63dac0f733b7 => generated 1523 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:26:26.117207 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-1ba8507e-667a-4aed-8e64-f1f7389b87fe tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:26:26.117954 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-1ba8507e-667a-4aed-8e64-f1f7389b87fe tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] [instance: 5ad11a1d-cf86-446c-9e0a-db8e16d3fbeb] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:26:26.125053 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-1ba8507e-667a-4aed-8e64-f1f7389b87fe tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:26:26.125488 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-1ba8507e-667a-4aed-8e64-f1f7389b87fe tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:26:26.126265 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-1ba8507e-667a-4aed-8e64-f1f7389b87fe tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:26:26.126752 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-1ba8507e-667a-4aed-8e64-f1f7389b87fe tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:26:26.131203 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG dbcounter [-] [118477] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:26:26.330019 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-1ba8507e-667a-4aed-8e64-f1f7389b87fe tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e916e4e0fb7140b0912e9233898a0016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd41986c224f414b8768675f40682380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:26:26.356729 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-1ba8507e-667a-4aed-8e64-f1f7389b87fe tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] 10.222.0.46 "GET /compute/v2.1/servers/5ad11a1d-cf86-446c-9e0a-db8e16d3fbeb" status: 200 len: 1554 microversion: 2.1 time: 0.243234 Aug 04 05:26:26.357526 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 87/169] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:26:26 2022] GET /compute/v2.1/servers/5ad11a1d-cf86-446c-9e0a-db8e16d3fbeb => generated 1554 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:26:26.905135 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-171e6d87-7165-48a5-85ec-7fda6b79e1b7 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:26:26.907756 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-171e6d87-7165-48a5-85ec-7fda6b79e1b7 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] [instance: 98f543b7-5432-4a4a-9494-63dac0f733b7] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:26:26.922098 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-171e6d87-7165-48a5-85ec-7fda6b79e1b7 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:26:26.923280 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-171e6d87-7165-48a5-85ec-7fda6b79e1b7 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:26:26.930790 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-171e6d87-7165-48a5-85ec-7fda6b79e1b7 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:26:26.930790 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-171e6d87-7165-48a5-85ec-7fda6b79e1b7 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:26:27.178520 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-171e6d87-7165-48a5-85ec-7fda6b79e1b7 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8f887f5689419e9e31a0ba43f76ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62d19c831574f9b99c993b5e41c645d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:26:27.189310 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-171e6d87-7165-48a5-85ec-7fda6b79e1b7 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] 10.222.0.46 "GET /compute/v2.1/servers/98f543b7-5432-4a4a-9494-63dac0f733b7" status: 200 len: 1523 microversion: 2.1 time: 0.290886 Aug 04 05:26:27.190328 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 83/170] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:26:26 2022] GET /compute/v2.1/servers/98f543b7-5432-4a4a-9494-63dac0f733b7 => generated 1523 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:26:27.383986 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-83930fac-60ce-48f4-83a5-fb6bf37b8972 tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:26:27.388441 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-83930fac-60ce-48f4-83a5-fb6bf37b8972 tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] [instance: 5ad11a1d-cf86-446c-9e0a-db8e16d3fbeb] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:26:27.426284 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-83930fac-60ce-48f4-83a5-fb6bf37b8972 tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:26:27.427400 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-83930fac-60ce-48f4-83a5-fb6bf37b8972 tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:26:27.429134 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-83930fac-60ce-48f4-83a5-fb6bf37b8972 tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:26:27.430082 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-83930fac-60ce-48f4-83a5-fb6bf37b8972 tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:26:27.493962 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [req-46996c00-73a4-4268-b378-337fcf38b0e1 req-64f73b1f-fbdb-4c2d-8d4b-02f9cb65ee14 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ad11a1d-cf86-446c-9e0a-db8e16d3fbeb", "name": "network-vif-deleted", "tag": "58dd9f97-dfe3-4321-8482-f27443e7ce4c"}]} {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:26:27.512700 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [req-46996c00-73a4-4268-b378-337fcf38b0e1 req-64f73b1f-fbdb-4c2d-8d4b-02f9cb65ee14 service nova] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:26:27.513307 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [req-46996c00-73a4-4268-b378-337fcf38b0e1 req-64f73b1f-fbdb-4c2d-8d4b-02f9cb65ee14 service nova] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:26:27.535925 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.compute.server_external_events [req-46996c00-73a4-4268-b378-337fcf38b0e1 req-64f73b1f-fbdb-4c2d-8d4b-02f9cb65ee14 service nova] Creating event network-vif-deleted:58dd9f97-dfe3-4321-8482-f27443e7ce4c for instance 5ad11a1d-cf86-446c-9e0a-db8e16d3fbeb on hv-cinder-85207 Aug 04 05:26:27.544641 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [req-46996c00-73a4-4268-b378-337fcf38b0e1 req-64f73b1f-fbdb-4c2d-8d4b-02f9cb65ee14 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055143 Aug 04 05:26:27.545781 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 84/171] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Aug 4 05:26:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 05:26:27.668721 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-83930fac-60ce-48f4-83a5-fb6bf37b8972 tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e916e4e0fb7140b0912e9233898a0016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd41986c224f414b8768675f40682380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:26:27.699992 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-83930fac-60ce-48f4-83a5-fb6bf37b8972 tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] 10.222.0.46 "GET /compute/v2.1/servers/5ad11a1d-cf86-446c-9e0a-db8e16d3fbeb" status: 200 len: 1512 microversion: 2.1 time: 0.322985 Aug 04 05:26:27.701010 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 88/172] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:26:27 2022] GET /compute/v2.1/servers/5ad11a1d-cf86-446c-9e0a-db8e16d3fbeb => generated 1512 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:26:28.220192 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-f8e5a77e-7826-4e5d-8087-20bf3e398f55 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:26:28.220904 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-f8e5a77e-7826-4e5d-8087-20bf3e398f55 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] [instance: 98f543b7-5432-4a4a-9494-63dac0f733b7] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:26:28.230272 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-f8e5a77e-7826-4e5d-8087-20bf3e398f55 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:26:28.231170 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-f8e5a77e-7826-4e5d-8087-20bf3e398f55 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:26:28.233053 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-f8e5a77e-7826-4e5d-8087-20bf3e398f55 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:26:28.233720 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-f8e5a77e-7826-4e5d-8087-20bf3e398f55 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:26:28.426861 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-f8e5a77e-7826-4e5d-8087-20bf3e398f55 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8f887f5689419e9e31a0ba43f76ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62d19c831574f9b99c993b5e41c645d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:26:28.435686 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-f8e5a77e-7826-4e5d-8087-20bf3e398f55 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] 10.222.0.46 "GET /compute/v2.1/servers/98f543b7-5432-4a4a-9494-63dac0f733b7" status: 200 len: 1523 microversion: 2.1 time: 0.223733 Aug 04 05:26:28.436631 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 85/173] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:26:28 2022] GET /compute/v2.1/servers/98f543b7-5432-4a4a-9494-63dac0f733b7 => generated 1523 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:26:28.721271 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-c57a1f2e-2ace-4742-b037-00d5de3aff37 tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:26:28.721882 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-c57a1f2e-2ace-4742-b037-00d5de3aff37 tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] [instance: 5ad11a1d-cf86-446c-9e0a-db8e16d3fbeb] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:26:28.730660 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-c57a1f2e-2ace-4742-b037-00d5de3aff37 tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:26:28.731248 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-c57a1f2e-2ace-4742-b037-00d5de3aff37 tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:26:28.732249 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-c57a1f2e-2ace-4742-b037-00d5de3aff37 tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:26:28.733138 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-c57a1f2e-2ace-4742-b037-00d5de3aff37 tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:26:28.788271 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-c57a1f2e-2ace-4742-b037-00d5de3aff37 tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:26:28.789334 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-c57a1f2e-2ace-4742-b037-00d5de3aff37 tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:26:28.789950 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.objects.instance [None req-c57a1f2e-2ace-4742-b037-00d5de3aff37 tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] Lazy-loading 'fault' on Instance uuid 5ad11a1d-cf86-446c-9e0a-db8e16d3fbeb {{(pid=118477) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 05:26:28.863621 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-c57a1f2e-2ace-4742-b037-00d5de3aff37 tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e916e4e0fb7140b0912e9233898a0016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd41986c224f414b8768675f40682380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:26:28.873542 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-c57a1f2e-2ace-4742-b037-00d5de3aff37 tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] 10.222.0.46 "GET /compute/v2.1/servers/5ad11a1d-cf86-446c-9e0a-db8e16d3fbeb" status: 200 len: 1351 microversion: 2.1 time: 0.156261 Aug 04 05:26:28.874120 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 89/174] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:26:28 2022] GET /compute/v2.1/servers/5ad11a1d-cf86-446c-9e0a-db8e16d3fbeb => generated 1351 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:26:29.456214 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-c627abe8-e223-479e-bd36-8cd8f6a98dab tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:26:29.456826 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-c627abe8-e223-479e-bd36-8cd8f6a98dab tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] [instance: 98f543b7-5432-4a4a-9494-63dac0f733b7] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:26:29.465046 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-c627abe8-e223-479e-bd36-8cd8f6a98dab tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:26:29.465687 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-c627abe8-e223-479e-bd36-8cd8f6a98dab tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:26:29.466857 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-c627abe8-e223-479e-bd36-8cd8f6a98dab tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:26:29.467303 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-c627abe8-e223-479e-bd36-8cd8f6a98dab tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:26:29.858679 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-c627abe8-e223-479e-bd36-8cd8f6a98dab tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8f887f5689419e9e31a0ba43f76ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62d19c831574f9b99c993b5e41c645d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:26:29.866477 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-c627abe8-e223-479e-bd36-8cd8f6a98dab tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] 10.222.0.46 "GET /compute/v2.1/servers/98f543b7-5432-4a4a-9494-63dac0f733b7" status: 200 len: 1523 microversion: 2.1 time: 0.414168 Aug 04 05:26:29.868456 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 86/175] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:26:29 2022] GET /compute/v2.1/servers/98f543b7-5432-4a4a-9494-63dac0f733b7 => generated 1523 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 05:26:29.907884 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-387f4b98-0b23-4d52-a134-46345ec1bc40 tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:26:29.909131 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-387f4b98-0b23-4d52-a134-46345ec1bc40 tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] [instance: 5ad11a1d-cf86-446c-9e0a-db8e16d3fbeb] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:26:29.915920 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-387f4b98-0b23-4d52-a134-46345ec1bc40 tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:26:29.917294 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-387f4b98-0b23-4d52-a134-46345ec1bc40 tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:26:29.918297 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-387f4b98-0b23-4d52-a134-46345ec1bc40 tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:26:29.918762 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-387f4b98-0b23-4d52-a134-46345ec1bc40 tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:26:29.936044 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.wsgi [None req-387f4b98-0b23-4d52-a134-46345ec1bc40 tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] HTTP exception thrown: Instance 5ad11a1d-cf86-446c-9e0a-db8e16d3fbeb could not be found. Aug 04 05:26:29.945216 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-387f4b98-0b23-4d52-a134-46345ec1bc40 tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] Request method failure captured: Aug 04 05:26:29.945216 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: request: GET /compute/v2.1/servers/5ad11a1d-cf86-446c-9e0a-db8e16d3fbeb HTTP/1.1 Aug 04 05:26:29.945216 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: Accept: application/json Aug 04 05:26:29.945216 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: Accept-Encoding: identity Aug 04 05:26:29.945216 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: Connection: close Aug 04 05:26:29.945216 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: Content-Length: 0 Aug 04 05:26:29.945216 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: Content-Type: application/json Aug 04 05:26:29.945216 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: Host: 10.222.0.46 Aug 04 05:26:29.945216 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: Openstack-System-Scope: None Aug 04 05:26:29.945216 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: User-Agent: python-urllib3/1.26.11 Aug 04 05:26:29.945216 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Auth-Token: gAAAAABi61g6js_CYJX_yjW6vPQ_PcvVTxShpwgsgsTFbjHr-7vvidLkNNe9oeKD7bxWQFk6VomZVQ5vDQkrXxzjTPde3pH_e24PDe9Ylkvm78Ug3KeRZtBCAdoc9IwzNV8psaQJ_60jijirgCLX1ebU3M92JNjGSK_CLELdxPR6GwA0Q81-FzU Aug 04 05:26:29.945216 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Domain-Id: None Aug 04 05:26:29.945216 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Domain-Name: None Aug 04 05:26:29.945216 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Identity-Status: Confirmed Aug 04 05:26:29.945216 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Is-Admin-Project: True Aug 04 05:26:29.945216 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Project-Domain-Id: default Aug 04 05:26:29.945216 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Project-Domain-Name: Default Aug 04 05:26:29.945216 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Project-Id: bd41986c224f414b8768675f40682380 Aug 04 05:26:29.945216 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Project-Name: tempest-DeleteServersTestJSON-2136111136 Aug 04 05:26:29.945216 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Role: member,reader Aug 04 05:26:29.945216 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Roles: member,reader Aug 04 05:26:29.946537 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/bd41986c224f414b8768675f40682380"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/bd41986c224f414b8768675f40682380"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_bd41986c224f414b8768675f40682380", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/bd41986c224f414b8768675f40682380"}]}] Aug 04 05:26:29.946537 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Tenant: tempest-DeleteServersTestJSON-2136111136 Aug 04 05:26:29.946537 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Tenant-Id: bd41986c224f414b8768675f40682380 Aug 04 05:26:29.946537 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Tenant-Name: tempest-DeleteServersTestJSON-2136111136 Aug 04 05:26:29.946537 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-User: tempest-DeleteServersTestJSON-2136111136-project Aug 04 05:26:29.946537 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-User-Domain-Id: default Aug 04 05:26:29.946537 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-User-Domain-Name: Default Aug 04 05:26:29.946537 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-User-Id: e916e4e0fb7140b0912e9233898a0016 Aug 04 05:26:29.946537 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-User-Name: tempest-DeleteServersTestJSON-2136111136-project Aug 04 05:26:29.946537 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: method: > Aug 04 05:26:29.946537 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: exception: Instance 5ad11a1d-cf86-446c-9e0a-db8e16d3fbeb could not be found. Aug 04 05:26:29.946537 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: action_args: {'id': '5ad11a1d-cf86-446c-9e0a-db8e16d3fbeb'} Aug 04 05:26:29.948075 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 05:26:29.948075 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:26:29.948075 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 05:26:29.948075 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 05:26:29.948075 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 05:26:29.948075 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 05:26:29.948075 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 05:26:29.948075 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 05:26:29.948075 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 05:26:29.948075 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 05:26:29.948075 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5ad11a1d-cf86-446c-9e0a-db8e16d3fbeb could not be found. Aug 04 05:26:29.948075 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Aug 04 05:26:29.948075 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:26:29.948075 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Aug 04 05:26:29.948075 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:26:29.948075 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:26:29.948075 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:26:29.948075 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 05:26:29.948075 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 05:26:29.948075 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 05:26:29.950153 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 05:26:29.950153 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 05:26:29.950153 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 05:26:29.950153 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 05:26:29.950153 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 05:26:29.950153 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 05:26:29.950153 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 05:26:29.950153 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5ad11a1d-cf86-446c-9e0a-db8e16d3fbeb could not be found. Aug 04 05:26:29.950153 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Aug 04 05:26:29.950153 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:26:29.950153 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Aug 04 05:26:29.950153 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:26:29.950153 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:26:29.950153 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:26:29.950153 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 05:26:29.950153 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 05:26:29.950153 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5ad11a1d-cf86-446c-9e0a-db8e16d3fbeb could not be found. Aug 04 05:26:29.950153 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Aug 04 05:26:29.953482 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-387f4b98-0b23-4d52-a134-46345ec1bc40 tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] Returning 404 to user: Instance 5ad11a1d-cf86-446c-9e0a-db8e16d3fbeb could not be found. {{(pid=118477) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 05:26:29.954766 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-387f4b98-0b23-4d52-a134-46345ec1bc40 tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] 10.222.0.46 "GET /compute/v2.1/servers/5ad11a1d-cf86-446c-9e0a-db8e16d3fbeb" status: 404 len: 111 microversion: 2.1 time: 0.052667 Aug 04 05:26:29.956344 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 90/176] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:26:29 2022] GET /compute/v2.1/servers/5ad11a1d-cf86-446c-9e0a-db8e16d3fbeb => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 05:26:30.265147 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-7bb829fd-c1d7-43e8-8f36-5629cb9c4281 tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:26:30.268365 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-7bb829fd-c1d7-43e8-8f36-5629cb9c4281 tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] [instance: 5ad11a1d-cf86-446c-9e0a-db8e16d3fbeb] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:26:30.274826 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-7bb829fd-c1d7-43e8-8f36-5629cb9c4281 tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:26:30.275282 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-7bb829fd-c1d7-43e8-8f36-5629cb9c4281 tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:26:30.276827 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-7bb829fd-c1d7-43e8-8f36-5629cb9c4281 tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:26:30.277270 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-7bb829fd-c1d7-43e8-8f36-5629cb9c4281 tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:26:30.292928 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.wsgi [None req-7bb829fd-c1d7-43e8-8f36-5629cb9c4281 tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] HTTP exception thrown: Instance 5ad11a1d-cf86-446c-9e0a-db8e16d3fbeb could not be found. Aug 04 05:26:30.303347 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-7bb829fd-c1d7-43e8-8f36-5629cb9c4281 tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] Request method failure captured: Aug 04 05:26:30.303347 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: request: GET /compute/v2.1/servers/5ad11a1d-cf86-446c-9e0a-db8e16d3fbeb/os-volume_attachments HTTP/1.1 Aug 04 05:26:30.303347 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: Accept: application/json Aug 04 05:26:30.303347 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: Accept-Encoding: identity Aug 04 05:26:30.303347 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: Connection: close Aug 04 05:26:30.303347 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: Content-Length: 0 Aug 04 05:26:30.303347 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: Content-Type: application/json Aug 04 05:26:30.303347 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: Host: 10.222.0.46 Aug 04 05:26:30.303347 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: Openstack-System-Scope: None Aug 04 05:26:30.303347 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: User-Agent: python-urllib3/1.26.11 Aug 04 05:26:30.303347 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Auth-Token: gAAAAABi61g6js_CYJX_yjW6vPQ_PcvVTxShpwgsgsTFbjHr-7vvidLkNNe9oeKD7bxWQFk6VomZVQ5vDQkrXxzjTPde3pH_e24PDe9Ylkvm78Ug3KeRZtBCAdoc9IwzNV8psaQJ_60jijirgCLX1ebU3M92JNjGSK_CLELdxPR6GwA0Q81-FzU Aug 04 05:26:30.303347 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Domain-Id: None Aug 04 05:26:30.303347 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Domain-Name: None Aug 04 05:26:30.303347 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Identity-Status: Confirmed Aug 04 05:26:30.303347 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Is-Admin-Project: True Aug 04 05:26:30.303347 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Project-Domain-Id: default Aug 04 05:26:30.303347 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Project-Domain-Name: Default Aug 04 05:26:30.303347 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Project-Id: bd41986c224f414b8768675f40682380 Aug 04 05:26:30.303347 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Project-Name: tempest-DeleteServersTestJSON-2136111136 Aug 04 05:26:30.303347 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Role: member,reader Aug 04 05:26:30.303347 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Roles: member,reader Aug 04 05:26:30.304925 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/bd41986c224f414b8768675f40682380"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/bd41986c224f414b8768675f40682380"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_bd41986c224f414b8768675f40682380", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/bd41986c224f414b8768675f40682380"}]}] Aug 04 05:26:30.304925 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Tenant: tempest-DeleteServersTestJSON-2136111136 Aug 04 05:26:30.304925 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Tenant-Id: bd41986c224f414b8768675f40682380 Aug 04 05:26:30.304925 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Tenant-Name: tempest-DeleteServersTestJSON-2136111136 Aug 04 05:26:30.304925 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-User: tempest-DeleteServersTestJSON-2136111136-project Aug 04 05:26:30.304925 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-User-Domain-Id: default Aug 04 05:26:30.304925 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-User-Domain-Name: Default Aug 04 05:26:30.304925 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-User-Id: e916e4e0fb7140b0912e9233898a0016 Aug 04 05:26:30.304925 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-User-Name: tempest-DeleteServersTestJSON-2136111136-project Aug 04 05:26:30.304925 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: method: > Aug 04 05:26:30.304925 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: exception: Instance 5ad11a1d-cf86-446c-9e0a-db8e16d3fbeb could not be found. Aug 04 05:26:30.304925 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: action_args: {'server_id': '5ad11a1d-cf86-446c-9e0a-db8e16d3fbeb'} Aug 04 05:26:30.305704 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 05:26:30.305704 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:26:30.305704 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 05:26:30.305704 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 05:26:30.305704 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 05:26:30.305704 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 05:26:30.305704 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 05:26:30.305704 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 05:26:30.305704 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 05:26:30.305704 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 05:26:30.305704 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5ad11a1d-cf86-446c-9e0a-db8e16d3fbeb could not be found. Aug 04 05:26:30.305704 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Aug 04 05:26:30.305704 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:26:30.305704 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Aug 04 05:26:30.305704 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:26:30.305704 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:26:30.305704 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:26:30.305704 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 05:26:30.305704 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 05:26:30.305704 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 05:26:30.306819 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 05:26:30.306819 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 04 05:26:30.306819 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 05:26:30.306819 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 04 05:26:30.306819 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 05:26:30.306819 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Aug 04 05:26:30.306819 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Aug 04 05:26:30.306819 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 05:26:30.306819 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 05:26:30.306819 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5ad11a1d-cf86-446c-9e0a-db8e16d3fbeb could not be found. Aug 04 05:26:30.306819 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Aug 04 05:26:30.306819 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:26:30.306819 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Aug 04 05:26:30.306819 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:26:30.306819 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:26:30.306819 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:26:30.306819 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 05:26:30.306819 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 05:26:30.306819 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5ad11a1d-cf86-446c-9e0a-db8e16d3fbeb could not be found. Aug 04 05:26:30.306819 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Aug 04 05:26:30.307963 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-7bb829fd-c1d7-43e8-8f36-5629cb9c4281 tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] Returning 404 to user: Instance 5ad11a1d-cf86-446c-9e0a-db8e16d3fbeb could not be found. {{(pid=118476) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 05:26:30.307963 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-7bb829fd-c1d7-43e8-8f36-5629cb9c4281 tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] 10.222.0.46 "GET /compute/v2.1/servers/5ad11a1d-cf86-446c-9e0a-db8e16d3fbeb/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.044387 Aug 04 05:26:30.307963 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 87/177] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Aug 4 05:26:30 2022] GET /compute/v2.1/servers/5ad11a1d-cf86-446c-9e0a-db8e16d3fbeb/os-volume_attachments => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 05:26:30.896263 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-0c3d30df-5be7-40ec-a99d-d41480f8bed4 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:26:30.897764 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-0c3d30df-5be7-40ec-a99d-d41480f8bed4 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] [instance: 98f543b7-5432-4a4a-9494-63dac0f733b7] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:26:30.933760 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-0c3d30df-5be7-40ec-a99d-d41480f8bed4 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:26:30.934608 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-0c3d30df-5be7-40ec-a99d-d41480f8bed4 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:26:30.935710 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-0c3d30df-5be7-40ec-a99d-d41480f8bed4 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:26:30.937120 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-0c3d30df-5be7-40ec-a99d-d41480f8bed4 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:26:31.112624 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-0c3d30df-5be7-40ec-a99d-d41480f8bed4 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8f887f5689419e9e31a0ba43f76ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62d19c831574f9b99c993b5e41c645d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:26:31.121011 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-0c3d30df-5be7-40ec-a99d-d41480f8bed4 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] 10.222.0.46 "GET /compute/v2.1/servers/98f543b7-5432-4a4a-9494-63dac0f733b7" status: 200 len: 1523 microversion: 2.1 time: 0.232625 Aug 04 05:26:31.121866 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 91/178] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:26:30 2022] GET /compute/v2.1/servers/98f543b7-5432-4a4a-9494-63dac0f733b7 => generated 1523 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:26:32.059877 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-0a67fcc2-8a4d-4cf6-83e6-538da9ead0dc tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:26:32.060525 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-0a67fcc2-8a4d-4cf6-83e6-538da9ead0dc tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] [instance: 5ad11a1d-cf86-446c-9e0a-db8e16d3fbeb] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:26:32.067467 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-0a67fcc2-8a4d-4cf6-83e6-538da9ead0dc tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:26:32.068331 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-0a67fcc2-8a4d-4cf6-83e6-538da9ead0dc tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:26:32.069320 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-0a67fcc2-8a4d-4cf6-83e6-538da9ead0dc tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:26:32.069973 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-0a67fcc2-8a4d-4cf6-83e6-538da9ead0dc tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:26:32.097648 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.wsgi [None req-0a67fcc2-8a4d-4cf6-83e6-538da9ead0dc tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] HTTP exception thrown: Instance 5ad11a1d-cf86-446c-9e0a-db8e16d3fbeb could not be found. Aug 04 05:26:32.097648 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-0a67fcc2-8a4d-4cf6-83e6-538da9ead0dc tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] Request method failure captured: Aug 04 05:26:32.097648 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: request: DELETE /compute/v2.1/servers/5ad11a1d-cf86-446c-9e0a-db8e16d3fbeb HTTP/1.1 Aug 04 05:26:32.097648 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: Accept: application/json Aug 04 05:26:32.097648 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: Accept-Encoding: identity Aug 04 05:26:32.097648 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: Connection: close Aug 04 05:26:32.097648 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: Content-Length: 0 Aug 04 05:26:32.097648 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: Content-Type: application/json Aug 04 05:26:32.097648 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: Host: 10.222.0.46 Aug 04 05:26:32.097648 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: Openstack-System-Scope: None Aug 04 05:26:32.097648 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: User-Agent: python-urllib3/1.26.11 Aug 04 05:26:32.097648 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Auth-Token: gAAAAABi61g6js_CYJX_yjW6vPQ_PcvVTxShpwgsgsTFbjHr-7vvidLkNNe9oeKD7bxWQFk6VomZVQ5vDQkrXxzjTPde3pH_e24PDe9Ylkvm78Ug3KeRZtBCAdoc9IwzNV8psaQJ_60jijirgCLX1ebU3M92JNjGSK_CLELdxPR6GwA0Q81-FzU Aug 04 05:26:32.097648 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Domain-Id: None Aug 04 05:26:32.097648 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Domain-Name: None Aug 04 05:26:32.097648 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Identity-Status: Confirmed Aug 04 05:26:32.097648 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Is-Admin-Project: True Aug 04 05:26:32.097648 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Project-Domain-Id: default Aug 04 05:26:32.097648 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Project-Domain-Name: Default Aug 04 05:26:32.097648 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Project-Id: bd41986c224f414b8768675f40682380 Aug 04 05:26:32.097648 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Project-Name: tempest-DeleteServersTestJSON-2136111136 Aug 04 05:26:32.097648 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Role: member,reader Aug 04 05:26:32.097648 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Roles: member,reader Aug 04 05:26:32.099620 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/bd41986c224f414b8768675f40682380"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/bd41986c224f414b8768675f40682380"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_bd41986c224f414b8768675f40682380", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/bd41986c224f414b8768675f40682380"}]}] Aug 04 05:26:32.099620 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Tenant: tempest-DeleteServersTestJSON-2136111136 Aug 04 05:26:32.099620 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Tenant-Id: bd41986c224f414b8768675f40682380 Aug 04 05:26:32.099620 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Tenant-Name: tempest-DeleteServersTestJSON-2136111136 Aug 04 05:26:32.099620 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-User: tempest-DeleteServersTestJSON-2136111136-project Aug 04 05:26:32.099620 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-User-Domain-Id: default Aug 04 05:26:32.099620 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-User-Domain-Name: Default Aug 04 05:26:32.099620 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-User-Id: e916e4e0fb7140b0912e9233898a0016 Aug 04 05:26:32.099620 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-User-Name: tempest-DeleteServersTestJSON-2136111136-project Aug 04 05:26:32.099620 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: method: > Aug 04 05:26:32.099620 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: exception: Instance 5ad11a1d-cf86-446c-9e0a-db8e16d3fbeb could not be found. Aug 04 05:26:32.099620 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: action_args: {'id': '5ad11a1d-cf86-446c-9e0a-db8e16d3fbeb'} Aug 04 05:26:32.100479 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 05:26:32.100479 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:26:32.100479 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 05:26:32.100479 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 05:26:32.100479 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 05:26:32.100479 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 05:26:32.100479 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 05:26:32.100479 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 05:26:32.100479 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 05:26:32.100479 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 05:26:32.100479 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5ad11a1d-cf86-446c-9e0a-db8e16d3fbeb could not be found. Aug 04 05:26:32.100479 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Aug 04 05:26:32.100479 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:26:32.100479 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Aug 04 05:26:32.100479 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:26:32.100479 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:26:32.100479 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:26:32.100479 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 05:26:32.100479 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 05:26:32.100479 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 05:26:32.101532 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 05:26:32.101532 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 05:26:32.101532 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 05:26:32.101532 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 05:26:32.101532 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 05:26:32.101532 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 05:26:32.101532 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 05:26:32.101532 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 05:26:32.101532 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 05:26:32.101532 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5ad11a1d-cf86-446c-9e0a-db8e16d3fbeb could not be found. Aug 04 05:26:32.101532 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Aug 04 05:26:32.101532 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:26:32.101532 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Aug 04 05:26:32.101532 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:26:32.101532 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:26:32.101532 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:26:32.101532 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 05:26:32.101532 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 05:26:32.101532 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5ad11a1d-cf86-446c-9e0a-db8e16d3fbeb could not be found. Aug 04 05:26:32.101532 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Aug 04 05:26:32.102666 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-0a67fcc2-8a4d-4cf6-83e6-538da9ead0dc tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] Returning 404 to user: Instance 5ad11a1d-cf86-446c-9e0a-db8e16d3fbeb could not be found. {{(pid=118476) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 05:26:32.102666 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-0a67fcc2-8a4d-4cf6-83e6-538da9ead0dc tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] 10.222.0.46 "DELETE /compute/v2.1/servers/5ad11a1d-cf86-446c-9e0a-db8e16d3fbeb" status: 404 len: 111 microversion: 2.1 time: 0.036846 Aug 04 05:26:32.102666 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 88/179] 10.222.0.46 () {58 vars in 1239 bytes} [Thu Aug 4 05:26:32 2022] DELETE /compute/v2.1/servers/5ad11a1d-cf86-446c-9e0a-db8e16d3fbeb => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 05:26:32.107982 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-513d37eb-e5e7-4d57-a1d2-eb1106999987 tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:26:32.108793 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-513d37eb-e5e7-4d57-a1d2-eb1106999987 tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] [instance: 5ad11a1d-cf86-446c-9e0a-db8e16d3fbeb] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:26:32.114880 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-513d37eb-e5e7-4d57-a1d2-eb1106999987 tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:26:32.115324 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-513d37eb-e5e7-4d57-a1d2-eb1106999987 tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:26:32.116130 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-513d37eb-e5e7-4d57-a1d2-eb1106999987 tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:26:32.116562 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-513d37eb-e5e7-4d57-a1d2-eb1106999987 tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:26:32.144500 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.wsgi [None req-513d37eb-e5e7-4d57-a1d2-eb1106999987 tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] HTTP exception thrown: Instance 5ad11a1d-cf86-446c-9e0a-db8e16d3fbeb could not be found. Aug 04 05:26:32.144596 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-9694e754-bfcd-4e9f-a169-db8365fd8444 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:26:32.144596 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-9694e754-bfcd-4e9f-a169-db8365fd8444 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] [instance: 98f543b7-5432-4a4a-9494-63dac0f733b7] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:26:32.145878 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-513d37eb-e5e7-4d57-a1d2-eb1106999987 tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] Request method failure captured: Aug 04 05:26:32.145878 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: request: GET /compute/v2.1/servers/5ad11a1d-cf86-446c-9e0a-db8e16d3fbeb HTTP/1.1 Aug 04 05:26:32.145878 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: Accept: application/json Aug 04 05:26:32.145878 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: Accept-Encoding: identity Aug 04 05:26:32.145878 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: Connection: close Aug 04 05:26:32.145878 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: Content-Length: 0 Aug 04 05:26:32.145878 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: Content-Type: application/json Aug 04 05:26:32.145878 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: Host: 10.222.0.46 Aug 04 05:26:32.145878 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: Openstack-System-Scope: None Aug 04 05:26:32.145878 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: User-Agent: python-urllib3/1.26.11 Aug 04 05:26:32.145878 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Auth-Token: gAAAAABi61g6js_CYJX_yjW6vPQ_PcvVTxShpwgsgsTFbjHr-7vvidLkNNe9oeKD7bxWQFk6VomZVQ5vDQkrXxzjTPde3pH_e24PDe9Ylkvm78Ug3KeRZtBCAdoc9IwzNV8psaQJ_60jijirgCLX1ebU3M92JNjGSK_CLELdxPR6GwA0Q81-FzU Aug 04 05:26:32.145878 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Domain-Id: None Aug 04 05:26:32.145878 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Domain-Name: None Aug 04 05:26:32.145878 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Identity-Status: Confirmed Aug 04 05:26:32.145878 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Is-Admin-Project: True Aug 04 05:26:32.145878 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Project-Domain-Id: default Aug 04 05:26:32.145878 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Project-Domain-Name: Default Aug 04 05:26:32.145878 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Project-Id: bd41986c224f414b8768675f40682380 Aug 04 05:26:32.145878 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Project-Name: tempest-DeleteServersTestJSON-2136111136 Aug 04 05:26:32.145878 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Role: member,reader Aug 04 05:26:32.145878 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Roles: member,reader Aug 04 05:26:32.148092 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/bd41986c224f414b8768675f40682380"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/bd41986c224f414b8768675f40682380"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_bd41986c224f414b8768675f40682380", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/bd41986c224f414b8768675f40682380"}]}] Aug 04 05:26:32.148092 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Tenant: tempest-DeleteServersTestJSON-2136111136 Aug 04 05:26:32.148092 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Tenant-Id: bd41986c224f414b8768675f40682380 Aug 04 05:26:32.148092 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Tenant-Name: tempest-DeleteServersTestJSON-2136111136 Aug 04 05:26:32.148092 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-User: tempest-DeleteServersTestJSON-2136111136-project Aug 04 05:26:32.148092 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-User-Domain-Id: default Aug 04 05:26:32.148092 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-User-Domain-Name: Default Aug 04 05:26:32.148092 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-User-Id: e916e4e0fb7140b0912e9233898a0016 Aug 04 05:26:32.148092 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-User-Name: tempest-DeleteServersTestJSON-2136111136-project Aug 04 05:26:32.148092 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: method: > Aug 04 05:26:32.148092 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: exception: Instance 5ad11a1d-cf86-446c-9e0a-db8e16d3fbeb could not be found. Aug 04 05:26:32.148092 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: action_args: {'id': '5ad11a1d-cf86-446c-9e0a-db8e16d3fbeb'} Aug 04 05:26:32.150095 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 05:26:32.150095 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:26:32.150095 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 05:26:32.150095 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 05:26:32.150095 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 05:26:32.150095 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 05:26:32.150095 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 05:26:32.150095 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 05:26:32.150095 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 05:26:32.150095 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 05:26:32.150095 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5ad11a1d-cf86-446c-9e0a-db8e16d3fbeb could not be found. Aug 04 05:26:32.150095 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Aug 04 05:26:32.150095 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:26:32.150095 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Aug 04 05:26:32.150095 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:26:32.150095 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:26:32.150095 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:26:32.150095 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 05:26:32.150095 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 05:26:32.150095 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 05:26:32.153402 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 05:26:32.153402 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 05:26:32.153402 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 05:26:32.153402 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 05:26:32.153402 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 05:26:32.153402 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 05:26:32.153402 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 05:26:32.153402 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5ad11a1d-cf86-446c-9e0a-db8e16d3fbeb could not be found. Aug 04 05:26:32.153402 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Aug 04 05:26:32.153402 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:26:32.153402 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Aug 04 05:26:32.153402 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:26:32.153402 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:26:32.153402 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:26:32.153402 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 05:26:32.153402 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 05:26:32.153402 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5ad11a1d-cf86-446c-9e0a-db8e16d3fbeb could not be found. Aug 04 05:26:32.153402 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Aug 04 05:26:32.169941 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-513d37eb-e5e7-4d57-a1d2-eb1106999987 tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] Returning 404 to user: Instance 5ad11a1d-cf86-446c-9e0a-db8e16d3fbeb could not be found. {{(pid=118477) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 05:26:32.169941 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-513d37eb-e5e7-4d57-a1d2-eb1106999987 tempest-DeleteServersTestJSON-2136111136 tempest-DeleteServersTestJSON-2136111136-project] 10.222.0.46 "GET /compute/v2.1/servers/5ad11a1d-cf86-446c-9e0a-db8e16d3fbeb" status: 404 len: 111 microversion: 2.1 time: 0.048215 Aug 04 05:26:32.169941 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 92/180] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:26:32 2022] GET /compute/v2.1/servers/5ad11a1d-cf86-446c-9e0a-db8e16d3fbeb => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 05:26:32.174831 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-9694e754-bfcd-4e9f-a169-db8365fd8444 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:26:32.174831 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-9694e754-bfcd-4e9f-a169-db8365fd8444 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:26:32.174831 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-9694e754-bfcd-4e9f-a169-db8365fd8444 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:26:32.174831 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-9694e754-bfcd-4e9f-a169-db8365fd8444 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:26:32.376753 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-9694e754-bfcd-4e9f-a169-db8365fd8444 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8f887f5689419e9e31a0ba43f76ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62d19c831574f9b99c993b5e41c645d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:26:32.384269 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-9694e754-bfcd-4e9f-a169-db8365fd8444 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] 10.222.0.46 "GET /compute/v2.1/servers/98f543b7-5432-4a4a-9494-63dac0f733b7" status: 200 len: 1523 microversion: 2.1 time: 0.245300 Aug 04 05:26:32.385802 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 89/181] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:26:32 2022] GET /compute/v2.1/servers/98f543b7-5432-4a4a-9494-63dac0f733b7 => generated 1523 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 05:26:33.406185 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-42520d7b-8e0f-424b-bfc6-85b54b9f1f8e tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:26:33.406850 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-42520d7b-8e0f-424b-bfc6-85b54b9f1f8e tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] [instance: 98f543b7-5432-4a4a-9494-63dac0f733b7] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:26:33.413388 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-42520d7b-8e0f-424b-bfc6-85b54b9f1f8e tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:26:33.413909 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-42520d7b-8e0f-424b-bfc6-85b54b9f1f8e tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:26:33.414753 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-42520d7b-8e0f-424b-bfc6-85b54b9f1f8e tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:26:33.415700 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-42520d7b-8e0f-424b-bfc6-85b54b9f1f8e tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:26:33.571674 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-42520d7b-8e0f-424b-bfc6-85b54b9f1f8e tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8f887f5689419e9e31a0ba43f76ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62d19c831574f9b99c993b5e41c645d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:26:33.582140 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-42520d7b-8e0f-424b-bfc6-85b54b9f1f8e tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] 10.222.0.46 "GET /compute/v2.1/servers/98f543b7-5432-4a4a-9494-63dac0f733b7" status: 200 len: 1523 microversion: 2.1 time: 0.179777 Aug 04 05:26:33.586192 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 93/182] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:26:33 2022] GET /compute/v2.1/servers/98f543b7-5432-4a4a-9494-63dac0f733b7 => generated 1523 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:26:34.607603 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-6942d1e9-820c-4608-8843-e54abff51465 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:26:34.608251 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-6942d1e9-820c-4608-8843-e54abff51465 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] [instance: 98f543b7-5432-4a4a-9494-63dac0f733b7] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:26:34.615162 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-6942d1e9-820c-4608-8843-e54abff51465 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:26:34.620329 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-6942d1e9-820c-4608-8843-e54abff51465 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:26:34.620329 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-6942d1e9-820c-4608-8843-e54abff51465 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:26:34.620329 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-6942d1e9-820c-4608-8843-e54abff51465 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:26:35.101339 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-6942d1e9-820c-4608-8843-e54abff51465 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8f887f5689419e9e31a0ba43f76ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62d19c831574f9b99c993b5e41c645d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:26:35.124757 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-6942d1e9-820c-4608-8843-e54abff51465 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] 10.222.0.46 "GET /compute/v2.1/servers/98f543b7-5432-4a4a-9494-63dac0f733b7" status: 200 len: 1523 microversion: 2.1 time: 0.517183 Aug 04 05:26:35.124757 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 90/183] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:26:34 2022] GET /compute/v2.1/servers/98f543b7-5432-4a4a-9494-63dac0f733b7 => generated 1523 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:26:36.154611 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-3e5468d9-7496-4c01-bfd8-1c490dc5c1e4 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:26:36.154611 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-3e5468d9-7496-4c01-bfd8-1c490dc5c1e4 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] [instance: 98f543b7-5432-4a4a-9494-63dac0f733b7] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:26:36.164538 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG dbcounter [-] [118477] Writing DB stats nova_api:SELECT=46 {{(pid=118477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:26:36.168019 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-3e5468d9-7496-4c01-bfd8-1c490dc5c1e4 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:26:36.169093 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-3e5468d9-7496-4c01-bfd8-1c490dc5c1e4 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:26:36.170966 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-3e5468d9-7496-4c01-bfd8-1c490dc5c1e4 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:26:36.171728 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-3e5468d9-7496-4c01-bfd8-1c490dc5c1e4 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:26:36.407867 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-3e5468d9-7496-4c01-bfd8-1c490dc5c1e4 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8f887f5689419e9e31a0ba43f76ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62d19c831574f9b99c993b5e41c645d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:26:36.416047 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-3e5468d9-7496-4c01-bfd8-1c490dc5c1e4 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] 10.222.0.46 "GET /compute/v2.1/servers/98f543b7-5432-4a4a-9494-63dac0f733b7" status: 200 len: 1523 microversion: 2.1 time: 0.271898 Aug 04 05:26:36.417629 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 94/184] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:26:36 2022] GET /compute/v2.1/servers/98f543b7-5432-4a4a-9494-63dac0f733b7 => generated 1523 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:26:37.440944 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-77f63ffa-bf51-4f54-8bd6-e10d34b6c0e8 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:26:37.442334 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-77f63ffa-bf51-4f54-8bd6-e10d34b6c0e8 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] [instance: 98f543b7-5432-4a4a-9494-63dac0f733b7] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:26:37.451274 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-77f63ffa-bf51-4f54-8bd6-e10d34b6c0e8 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:26:37.452191 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-77f63ffa-bf51-4f54-8bd6-e10d34b6c0e8 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:26:37.453295 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-77f63ffa-bf51-4f54-8bd6-e10d34b6c0e8 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:26:37.454138 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-77f63ffa-bf51-4f54-8bd6-e10d34b6c0e8 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:26:37.460397 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG dbcounter [-] [118476] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:26:37.642180 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-77f63ffa-bf51-4f54-8bd6-e10d34b6c0e8 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8f887f5689419e9e31a0ba43f76ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62d19c831574f9b99c993b5e41c645d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:26:37.650095 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-77f63ffa-bf51-4f54-8bd6-e10d34b6c0e8 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] 10.222.0.46 "GET /compute/v2.1/servers/98f543b7-5432-4a4a-9494-63dac0f733b7" status: 200 len: 1523 microversion: 2.1 time: 0.214677 Aug 04 05:26:37.651454 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 91/185] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:26:37 2022] GET /compute/v2.1/servers/98f543b7-5432-4a4a-9494-63dac0f733b7 => generated 1523 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:26:38.674825 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-e1906f07-9bb6-4007-93b3-125ebd9f0b75 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:26:38.675496 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-e1906f07-9bb6-4007-93b3-125ebd9f0b75 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] [instance: 98f543b7-5432-4a4a-9494-63dac0f733b7] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:26:38.684347 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-e1906f07-9bb6-4007-93b3-125ebd9f0b75 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:26:38.685763 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-e1906f07-9bb6-4007-93b3-125ebd9f0b75 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:26:38.690874 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-e1906f07-9bb6-4007-93b3-125ebd9f0b75 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:26:38.696991 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-e1906f07-9bb6-4007-93b3-125ebd9f0b75 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:26:38.969329 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-e1906f07-9bb6-4007-93b3-125ebd9f0b75 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8f887f5689419e9e31a0ba43f76ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62d19c831574f9b99c993b5e41c645d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:26:38.979873 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-e1906f07-9bb6-4007-93b3-125ebd9f0b75 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] 10.222.0.46 "GET /compute/v2.1/servers/98f543b7-5432-4a4a-9494-63dac0f733b7" status: 200 len: 1523 microversion: 2.1 time: 0.309587 Aug 04 05:26:38.995474 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 95/186] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:26:38 2022] GET /compute/v2.1/servers/98f543b7-5432-4a4a-9494-63dac0f733b7 => generated 1523 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:26:40.002034 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-9742cc36-17fa-477e-af25-2457f336f007 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:26:40.002683 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-9742cc36-17fa-477e-af25-2457f336f007 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] [instance: 98f543b7-5432-4a4a-9494-63dac0f733b7] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:26:40.017443 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-9742cc36-17fa-477e-af25-2457f336f007 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:26:40.018243 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-9742cc36-17fa-477e-af25-2457f336f007 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:26:40.019323 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-9742cc36-17fa-477e-af25-2457f336f007 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:26:40.019793 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-9742cc36-17fa-477e-af25-2457f336f007 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:26:40.183714 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-9742cc36-17fa-477e-af25-2457f336f007 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8f887f5689419e9e31a0ba43f76ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62d19c831574f9b99c993b5e41c645d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:26:40.193789 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-9742cc36-17fa-477e-af25-2457f336f007 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] 10.222.0.46 "GET /compute/v2.1/servers/98f543b7-5432-4a4a-9494-63dac0f733b7" status: 200 len: 1523 microversion: 2.1 time: 0.194052 Aug 04 05:26:40.197913 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 92/187] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:26:39 2022] GET /compute/v2.1/servers/98f543b7-5432-4a4a-9494-63dac0f733b7 => generated 1523 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:26:41.242428 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-2bafe134-fcdb-477d-9e1a-cd0f034b0b3a tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:26:41.243263 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-2bafe134-fcdb-477d-9e1a-cd0f034b0b3a tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] [instance: 98f543b7-5432-4a4a-9494-63dac0f733b7] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:26:41.258457 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-2bafe134-fcdb-477d-9e1a-cd0f034b0b3a tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:26:41.259995 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-2bafe134-fcdb-477d-9e1a-cd0f034b0b3a tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:26:41.261675 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-2bafe134-fcdb-477d-9e1a-cd0f034b0b3a tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:26:41.262252 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-2bafe134-fcdb-477d-9e1a-cd0f034b0b3a tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:26:41.417833 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-2bafe134-fcdb-477d-9e1a-cd0f034b0b3a tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8f887f5689419e9e31a0ba43f76ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62d19c831574f9b99c993b5e41c645d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:26:41.426567 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-2bafe134-fcdb-477d-9e1a-cd0f034b0b3a tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] 10.222.0.46 "GET /compute/v2.1/servers/98f543b7-5432-4a4a-9494-63dac0f733b7" status: 200 len: 1523 microversion: 2.1 time: 0.213131 Aug 04 05:26:41.427150 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 96/188] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:26:41 2022] GET /compute/v2.1/servers/98f543b7-5432-4a4a-9494-63dac0f733b7 => generated 1523 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:26:42.450351 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-9352f5c3-9321-4a5f-9a21-0ba6b326fbd7 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:26:42.450968 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-9352f5c3-9321-4a5f-9a21-0ba6b326fbd7 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] [instance: 98f543b7-5432-4a4a-9494-63dac0f733b7] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:26:42.458195 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-9352f5c3-9321-4a5f-9a21-0ba6b326fbd7 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:26:42.458674 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-9352f5c3-9321-4a5f-9a21-0ba6b326fbd7 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:26:42.459439 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-9352f5c3-9321-4a5f-9a21-0ba6b326fbd7 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:26:42.459866 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-9352f5c3-9321-4a5f-9a21-0ba6b326fbd7 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:26:42.711097 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-9352f5c3-9321-4a5f-9a21-0ba6b326fbd7 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8f887f5689419e9e31a0ba43f76ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62d19c831574f9b99c993b5e41c645d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:26:42.723586 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-9352f5c3-9321-4a5f-9a21-0ba6b326fbd7 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] 10.222.0.46 "GET /compute/v2.1/servers/98f543b7-5432-4a4a-9494-63dac0f733b7" status: 200 len: 1523 microversion: 2.1 time: 0.278157 Aug 04 05:26:42.724540 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 93/189] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:26:42 2022] GET /compute/v2.1/servers/98f543b7-5432-4a4a-9494-63dac0f733b7 => generated 1523 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:26:43.752732 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-b874daaa-11aa-4636-b5d1-9ec93a084e98 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:26:43.754938 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-b874daaa-11aa-4636-b5d1-9ec93a084e98 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] [instance: 98f543b7-5432-4a4a-9494-63dac0f733b7] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:26:43.771208 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-b874daaa-11aa-4636-b5d1-9ec93a084e98 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:26:43.773990 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-b874daaa-11aa-4636-b5d1-9ec93a084e98 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:26:43.775000 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-b874daaa-11aa-4636-b5d1-9ec93a084e98 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:26:43.775508 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-b874daaa-11aa-4636-b5d1-9ec93a084e98 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:26:44.403490 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-b874daaa-11aa-4636-b5d1-9ec93a084e98 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8f887f5689419e9e31a0ba43f76ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62d19c831574f9b99c993b5e41c645d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:26:44.422830 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-b874daaa-11aa-4636-b5d1-9ec93a084e98 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] 10.222.0.46 "GET /compute/v2.1/servers/98f543b7-5432-4a4a-9494-63dac0f733b7" status: 200 len: 1523 microversion: 2.1 time: 0.670257 Aug 04 05:26:44.422830 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 97/190] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:26:43 2022] GET /compute/v2.1/servers/98f543b7-5432-4a4a-9494-63dac0f733b7 => generated 1523 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:26:45.442449 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-5ed00874-518b-48eb-897c-91781b0acff4 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:26:45.442942 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-5ed00874-518b-48eb-897c-91781b0acff4 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] [instance: 98f543b7-5432-4a4a-9494-63dac0f733b7] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:26:45.448963 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG dbcounter [-] [118476] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=1 {{(pid=118476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:26:45.460557 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-5ed00874-518b-48eb-897c-91781b0acff4 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:26:45.461024 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-5ed00874-518b-48eb-897c-91781b0acff4 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:26:45.461851 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-5ed00874-518b-48eb-897c-91781b0acff4 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:26:45.466496 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-5ed00874-518b-48eb-897c-91781b0acff4 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:26:45.915217 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-5ed00874-518b-48eb-897c-91781b0acff4 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8f887f5689419e9e31a0ba43f76ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62d19c831574f9b99c993b5e41c645d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:26:45.927362 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-5ed00874-518b-48eb-897c-91781b0acff4 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] 10.222.0.46 "GET /compute/v2.1/servers/98f543b7-5432-4a4a-9494-63dac0f733b7" status: 200 len: 1503 microversion: 2.1 time: 0.491946 Aug 04 05:26:45.927966 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 94/191] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:26:45 2022] GET /compute/v2.1/servers/98f543b7-5432-4a4a-9494-63dac0f733b7 => generated 1503 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:26:45.974385 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-415690d7-4cf2-4a02-aad3-b1101b806a4b tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:26:45.977061 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-415690d7-4cf2-4a02-aad3-b1101b806a4b tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] [instance: b1a612df-55d1-4106-951d-7f0ea95cfe83] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:26:45.990514 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-415690d7-4cf2-4a02-aad3-b1101b806a4b tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:26:45.991723 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-415690d7-4cf2-4a02-aad3-b1101b806a4b tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:26:45.995094 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-415690d7-4cf2-4a02-aad3-b1101b806a4b tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:26:45.996426 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-415690d7-4cf2-4a02-aad3-b1101b806a4b tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:26:46.273824 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-415690d7-4cf2-4a02-aad3-b1101b806a4b tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8f887f5689419e9e31a0ba43f76ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62d19c831574f9b99c993b5e41c645d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:26:46.282978 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-415690d7-4cf2-4a02-aad3-b1101b806a4b tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] 10.222.0.46 "GET /compute/v2.1/servers/b1a612df-55d1-4106-951d-7f0ea95cfe83" status: 200 len: 1516 microversion: 2.1 time: 0.317829 Aug 04 05:26:46.283575 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 98/192] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:26:45 2022] GET /compute/v2.1/servers/b1a612df-55d1-4106-951d-7f0ea95cfe83 => generated 1516 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:26:48.850806 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-f668b4eb-7dd9-475d-aac8-18f6a5617ebd tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:26:48.856504 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-f668b4eb-7dd9-475d-aac8-18f6a5617ebd tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] [instance: b1a612df-55d1-4106-951d-7f0ea95cfe83] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:26:48.879096 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-f668b4eb-7dd9-475d-aac8-18f6a5617ebd tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:26:48.883716 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-f668b4eb-7dd9-475d-aac8-18f6a5617ebd tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:26:48.885357 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-f668b4eb-7dd9-475d-aac8-18f6a5617ebd tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:26:48.885874 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-f668b4eb-7dd9-475d-aac8-18f6a5617ebd tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:26:48.945551 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.objects.instance [None req-f668b4eb-7dd9-475d-aac8-18f6a5617ebd tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lazy-loading 'flavor' on Instance uuid b1a612df-55d1-4106-951d-7f0ea95cfe83 {{(pid=118476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 05:26:49.566494 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-f668b4eb-7dd9-475d-aac8-18f6a5617ebd tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] 10.222.0.46 "POST /compute/v2.1/servers/b1a612df-55d1-4106-951d-7f0ea95cfe83/action" status: 200 len: 32 microversion: 2.1 time: 0.721103 Aug 04 05:26:49.571401 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 95/193] 10.222.0.46 () {60 vars in 1278 bytes} [Thu Aug 4 05:26:48 2022] POST /compute/v2.1/servers/b1a612df-55d1-4106-951d-7f0ea95cfe83/action => generated 32 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 05:26:49.591949 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-5bb7ae8c-6719-4c27-9c19-dc93d0c20c5f tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:26:49.595920 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-5bb7ae8c-6719-4c27-9c19-dc93d0c20c5f tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] [instance: b1a612df-55d1-4106-951d-7f0ea95cfe83] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:26:49.610015 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-5bb7ae8c-6719-4c27-9c19-dc93d0c20c5f tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:26:49.610674 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-5bb7ae8c-6719-4c27-9c19-dc93d0c20c5f tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:26:49.612357 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-5bb7ae8c-6719-4c27-9c19-dc93d0c20c5f tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:26:49.622629 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-5bb7ae8c-6719-4c27-9c19-dc93d0c20c5f tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:26:50.016059 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-5bb7ae8c-6719-4c27-9c19-dc93d0c20c5f tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8f887f5689419e9e31a0ba43f76ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62d19c831574f9b99c993b5e41c645d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:26:50.027720 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-5bb7ae8c-6719-4c27-9c19-dc93d0c20c5f tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] 10.222.0.46 "GET /compute/v2.1/servers/b1a612df-55d1-4106-951d-7f0ea95cfe83" status: 200 len: 1522 microversion: 2.1 time: 0.452892 Aug 04 05:26:50.045276 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 99/194] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:26:49 2022] GET /compute/v2.1/servers/b1a612df-55d1-4106-951d-7f0ea95cfe83 => generated 1522 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:26:51.056978 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-7ed76c4f-7e0f-4cf5-8312-b6ccdd4c6a95 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:26:51.058720 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-7ed76c4f-7e0f-4cf5-8312-b6ccdd4c6a95 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] [instance: b1a612df-55d1-4106-951d-7f0ea95cfe83] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:26:51.082794 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-7ed76c4f-7e0f-4cf5-8312-b6ccdd4c6a95 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:26:51.083329 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-7ed76c4f-7e0f-4cf5-8312-b6ccdd4c6a95 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:26:51.084150 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-7ed76c4f-7e0f-4cf5-8312-b6ccdd4c6a95 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:26:51.087381 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-7ed76c4f-7e0f-4cf5-8312-b6ccdd4c6a95 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:26:51.421148 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-7ed76c4f-7e0f-4cf5-8312-b6ccdd4c6a95 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8f887f5689419e9e31a0ba43f76ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62d19c831574f9b99c993b5e41c645d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:26:51.446932 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-7ed76c4f-7e0f-4cf5-8312-b6ccdd4c6a95 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] 10.222.0.46 "GET /compute/v2.1/servers/b1a612df-55d1-4106-951d-7f0ea95cfe83" status: 200 len: 1522 microversion: 2.1 time: 0.394725 Aug 04 05:26:51.447949 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 96/195] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:26:51 2022] GET /compute/v2.1/servers/b1a612df-55d1-4106-951d-7f0ea95cfe83 => generated 1522 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 05:26:52.041990 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-a88fd63e-874a-4ab1-b1d1-45b2a71dc6ab tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Action: 'create', calling method: .version_select at 0x7f147575a9d0>, body: {"keypair": {"name": "tempest-keypair-1378104158", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFcnOuZB1+rCu7N2Yxu6uP+U1VRj1rIbVkZUd9WqmFqgMJ+PHVBTSvGuSJDZdYk4pK4saDMjwI54f6O5NvKGlpWBb+btJPx4eHukt+vNkMHfXQX2ATlQcOP7k382ci9zGw=="}} {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:26:52.082776 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.quota [None req-a88fd63e-874a-4ab1-b1d1-45b2a71dc6ab tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Getting quotas for project d1ca4b83dc874bda9f33e06f4910608c. Resources: {'key_pairs'} {{(pid=118477) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 05:26:52.097377 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.quota [None req-a88fd63e-874a-4ab1-b1d1-45b2a71dc6ab tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Getting quotas for user eb4dea95659c473b9b193c6234186430 and project d1ca4b83dc874bda9f33e06f4910608c. Resources: {'key_pairs'} {{(pid=118477) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 05:26:52.184879 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-8f4f2be8-8f53-4d6f-98af-7b84f6f211b4 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:26:52.186463 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-8f4f2be8-8f53-4d6f-98af-7b84f6f211b4 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] [instance: 384721d7-1467-45cd-af93-eb458115f75e] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:26:52.197567 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-8f4f2be8-8f53-4d6f-98af-7b84f6f211b4 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:26:52.198460 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-8f4f2be8-8f53-4d6f-98af-7b84f6f211b4 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:26:52.199665 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-8f4f2be8-8f53-4d6f-98af-7b84f6f211b4 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:26:52.200252 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-8f4f2be8-8f53-4d6f-98af-7b84f6f211b4 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:26:52.283037 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-a88fd63e-874a-4ab1-b1d1-45b2a71dc6ab tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.593985 Aug 04 05:26:52.283980 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 100/196] 10.222.0.46 () {60 vars in 1159 bytes} [Thu Aug 4 05:26:51 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:26:52.317979 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-8f4f2be8-8f53-4d6f-98af-7b84f6f211b4 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] 10.222.0.46 "GET /compute/v2.1/servers/384721d7-1467-45cd-af93-eb458115f75e/ips" status: 200 len: 149 microversion: 2.1 time: 0.147756 Aug 04 05:26:52.326180 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 97/197] 10.222.0.46 () {58 vars in 1248 bytes} [Thu Aug 4 05:26:52 2022] GET /compute/v2.1/servers/384721d7-1467-45cd-af93-eb458115f75e/ips => generated 149 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:26:52.474095 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-66f34f1f-14ab-42a0-b92d-67ddfd29cba2 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:26:52.475003 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-66f34f1f-14ab-42a0-b92d-67ddfd29cba2 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] [instance: b1a612df-55d1-4106-951d-7f0ea95cfe83] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:26:52.493752 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-66f34f1f-14ab-42a0-b92d-67ddfd29cba2 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:26:52.497286 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-66f34f1f-14ab-42a0-b92d-67ddfd29cba2 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:26:52.520340 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-66f34f1f-14ab-42a0-b92d-67ddfd29cba2 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:26:52.545095 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-66f34f1f-14ab-42a0-b92d-67ddfd29cba2 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.031s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:26:52.992310 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-66f34f1f-14ab-42a0-b92d-67ddfd29cba2 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8f887f5689419e9e31a0ba43f76ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62d19c831574f9b99c993b5e41c645d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:26:53.003439 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-66f34f1f-14ab-42a0-b92d-67ddfd29cba2 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] 10.222.0.46 "GET /compute/v2.1/servers/b1a612df-55d1-4106-951d-7f0ea95cfe83" status: 200 len: 1522 microversion: 2.1 time: 0.533458 Aug 04 05:26:53.004522 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 101/198] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:26:52 2022] GET /compute/v2.1/servers/b1a612df-55d1-4106-951d-7f0ea95cfe83 => generated 1522 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:26:54.027762 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-01e840d4-b33f-437c-ac02-ecb84f0c23c3 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:26:54.028524 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-01e840d4-b33f-437c-ac02-ecb84f0c23c3 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] [instance: b1a612df-55d1-4106-951d-7f0ea95cfe83] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:26:54.037209 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-01e840d4-b33f-437c-ac02-ecb84f0c23c3 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:26:54.038065 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-01e840d4-b33f-437c-ac02-ecb84f0c23c3 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:26:54.039259 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-01e840d4-b33f-437c-ac02-ecb84f0c23c3 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:26:54.039809 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-01e840d4-b33f-437c-ac02-ecb84f0c23c3 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:26:54.426268 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-01e840d4-b33f-437c-ac02-ecb84f0c23c3 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8f887f5689419e9e31a0ba43f76ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62d19c831574f9b99c993b5e41c645d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:26:54.442406 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-01e840d4-b33f-437c-ac02-ecb84f0c23c3 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] 10.222.0.46 "GET /compute/v2.1/servers/b1a612df-55d1-4106-951d-7f0ea95cfe83" status: 200 len: 1522 microversion: 2.1 time: 0.420664 Aug 04 05:26:54.444268 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 98/199] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:26:54 2022] GET /compute/v2.1/servers/b1a612df-55d1-4106-951d-7f0ea95cfe83 => generated 1522 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:26:54.845855 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-c4a2510e-6d51-4078-8181-7aaae9b5dc87 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2df06300-47c9-4304-818b-31a0903cd559"}} {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:26:54.848661 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-c4a2510e-6d51-4078-8181-7aaae9b5dc87 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] [instance: 384721d7-1467-45cd-af93-eb458115f75e] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:26:54.875685 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-c4a2510e-6d51-4078-8181-7aaae9b5dc87 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:26:54.876151 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-c4a2510e-6d51-4078-8181-7aaae9b5dc87 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:26:54.876954 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-c4a2510e-6d51-4078-8181-7aaae9b5dc87 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:26:54.877392 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-c4a2510e-6d51-4078-8181-7aaae9b5dc87 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:26:55.469895 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-a42bb912-1e92-4112-bd79-c12a69b304bf tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:26:55.471338 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-a42bb912-1e92-4112-bd79-c12a69b304bf tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] [instance: b1a612df-55d1-4106-951d-7f0ea95cfe83] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:26:55.498517 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-a42bb912-1e92-4112-bd79-c12a69b304bf tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:26:55.499373 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-a42bb912-1e92-4112-bd79-c12a69b304bf tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:26:55.500394 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-a42bb912-1e92-4112-bd79-c12a69b304bf tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:26:55.500996 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-a42bb912-1e92-4112-bd79-c12a69b304bf tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:26:55.866357 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-a42bb912-1e92-4112-bd79-c12a69b304bf tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8f887f5689419e9e31a0ba43f76ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62d19c831574f9b99c993b5e41c645d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:26:55.916911 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-a42bb912-1e92-4112-bd79-c12a69b304bf tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] 10.222.0.46 "GET /compute/v2.1/servers/b1a612df-55d1-4106-951d-7f0ea95cfe83" status: 200 len: 1522 microversion: 2.1 time: 0.455695 Aug 04 05:26:55.917929 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 99/200] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:26:55 2022] GET /compute/v2.1/servers/b1a612df-55d1-4106-951d-7f0ea95cfe83 => generated 1522 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:26:56.040008 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-c4a2510e-6d51-4078-8181-7aaae9b5dc87 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] 10.222.0.46 "POST /compute/v2.1/servers/384721d7-1467-45cd-af93-eb458115f75e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.198393 Aug 04 05:26:56.043809 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 102/201] 10.222.0.46 () {60 vars in 1323 bytes} [Thu Aug 4 05:26:54 2022] POST /compute/v2.1/servers/384721d7-1467-45cd-af93-eb458115f75e/os-volume_attachments => generated 194 bytes in 1201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:26:56.957031 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-15c12249-e8ad-467e-8745-3c8c09652fe0 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:26:56.962493 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-15c12249-e8ad-467e-8745-3c8c09652fe0 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] [instance: b1a612df-55d1-4106-951d-7f0ea95cfe83] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:26:56.990819 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-15c12249-e8ad-467e-8745-3c8c09652fe0 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:26:56.993803 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-15c12249-e8ad-467e-8745-3c8c09652fe0 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:26:56.999983 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-15c12249-e8ad-467e-8745-3c8c09652fe0 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:26:56.999983 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-15c12249-e8ad-467e-8745-3c8c09652fe0 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:26:57.352424 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-15c12249-e8ad-467e-8745-3c8c09652fe0 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8f887f5689419e9e31a0ba43f76ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62d19c831574f9b99c993b5e41c645d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:26:57.366190 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-15c12249-e8ad-467e-8745-3c8c09652fe0 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] 10.222.0.46 "GET /compute/v2.1/servers/b1a612df-55d1-4106-951d-7f0ea95cfe83" status: 200 len: 1522 microversion: 2.1 time: 0.413554 Aug 04 05:26:57.370849 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 100/202] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:26:56 2022] GET /compute/v2.1/servers/b1a612df-55d1-4106-951d-7f0ea95cfe83 => generated 1522 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:26:57.578404 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-f8fc64fa-9798-440b-8ce0-36d1a4145e7d tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1101760748", "imageRef": "4613f7d0-37ca-46ad-bb26-dc4990dd7d6f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "bfbea54a-6e02-4895-9b85-ca7cad74aeed"}], "security_groups": [{"name": "tempest-securitygroup--516201416"}], "key_name": "tempest-keypair-1378104158", "user_data": "}} {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:26:57.793677 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.network.neutron [None req-f8fc64fa-9798-440b-8ce0-36d1a4145e7d tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] validate_networks() for [('bfbea54a-6e02-4895-9b85-ca7cad74aeed', None, None, None, None, None)] {{(pid=118477) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 05:26:58.386236 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.virt.hardware [None req-f8fc64fa-9798-440b-8ce0-36d1a4145e7d tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Flavor limits 0:0:0 {{(pid=118477) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 05:26:58.386689 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.virt.hardware [None req-f8fc64fa-9798-440b-8ce0-36d1a4145e7d tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Image limits 0:0:0 {{(pid=118477) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 05:26:58.387169 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.virt.hardware [None req-f8fc64fa-9798-440b-8ce0-36d1a4145e7d tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Flavor pref 0:0:0 {{(pid=118477) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 05:26:58.387578 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.virt.hardware [None req-f8fc64fa-9798-440b-8ce0-36d1a4145e7d tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Image pref 0:0:0 {{(pid=118477) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 05:26:58.387988 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.virt.hardware [None req-f8fc64fa-9798-440b-8ce0-36d1a4145e7d tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118477) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 05:26:58.407185 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-a28b950f-b2a9-4b16-a37b-8f04974695f6 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:26:58.408512 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-a28b950f-b2a9-4b16-a37b-8f04974695f6 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] [instance: b1a612df-55d1-4106-951d-7f0ea95cfe83] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:26:58.418120 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-f8fc64fa-9798-440b-8ce0-36d1a4145e7d tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:26:58.418120 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-f8fc64fa-9798-440b-8ce0-36d1a4145e7d tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:26:58.418120 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-f8fc64fa-9798-440b-8ce0-36d1a4145e7d tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:26:58.418120 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-f8fc64fa-9798-440b-8ce0-36d1a4145e7d tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:26:58.418604 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-a28b950f-b2a9-4b16-a37b-8f04974695f6 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:26:58.418604 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-a28b950f-b2a9-4b16-a37b-8f04974695f6 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:26:58.418604 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-a28b950f-b2a9-4b16-a37b-8f04974695f6 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:26:58.418604 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-a28b950f-b2a9-4b16-a37b-8f04974695f6 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:26:58.464887 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.quota [None req-f8fc64fa-9798-440b-8ce0-36d1a4145e7d tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Getting quotas for project d1ca4b83dc874bda9f33e06f4910608c. Resources: {'instances', 'cores', 'ram'} {{(pid=118477) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 05:26:58.469675 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.quota [None req-f8fc64fa-9798-440b-8ce0-36d1a4145e7d tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Getting quotas for user eb4dea95659c473b9b193c6234186430 and project d1ca4b83dc874bda9f33e06f4910608c. Resources: {'instances', 'cores', 'ram'} {{(pid=118477) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 05:26:58.497741 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-f8fc64fa-9798-440b-8ce0-36d1a4145e7d tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Going to run 1 instances... {{(pid=118477) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 05:26:58.500687 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-f8fc64fa-9798-440b-8ce0-36d1a4145e7d tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] [instance: 9333850c-071c-4330-98b9-84232a752ffe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4613f7d0-37ca-46ad-bb26-dc4990dd7d6f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118477) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 05:26:58.628920 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-a28b950f-b2a9-4b16-a37b-8f04974695f6 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8f887f5689419e9e31a0ba43f76ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62d19c831574f9b99c993b5e41c645d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:26:58.638764 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-a28b950f-b2a9-4b16-a37b-8f04974695f6 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] 10.222.0.46 "GET /compute/v2.1/servers/b1a612df-55d1-4106-951d-7f0ea95cfe83" status: 200 len: 1522 microversion: 2.1 time: 0.245484 Aug 04 05:26:58.639732 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 101/203] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:26:58 2022] GET /compute/v2.1/servers/b1a612df-55d1-4106-951d-7f0ea95cfe83 => generated 1522 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:26:58.682850 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-f8fc64fa-9798-440b-8ce0-36d1a4145e7d tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.110560 Aug 04 05:26:58.684989 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 103/204] 10.222.0.46 () {60 vars in 1147 bytes} [Thu Aug 4 05:26:57 2022] POST /compute/v2.1/servers => generated 401 bytes in 1113 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 05:26:58.698240 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-46775e3c-4eb0-414b-9b71-899eae2f19ee tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:26:58.699443 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-46775e3c-4eb0-414b-9b71-899eae2f19ee tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] [instance: 9333850c-071c-4330-98b9-84232a752ffe] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:26:58.782509 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-46775e3c-4eb0-414b-9b71-899eae2f19ee tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb4dea95659c473b9b193c6234186430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1ca4b83dc874bda9f33e06f4910608c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:26:58.790832 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-46775e3c-4eb0-414b-9b71-899eae2f19ee tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] 10.222.0.46 "GET /compute/v2.1/servers/9333850c-071c-4330-98b9-84232a752ffe" status: 200 len: 1238 microversion: 2.1 time: 0.099017 Aug 04 05:26:58.791419 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 102/205] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:26:58 2022] GET /compute/v2.1/servers/9333850c-071c-4330-98b9-84232a752ffe => generated 1238 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:26:59.681689 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-d4ed789e-d55d-4058-b853-b7823b426b89 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:26:59.683912 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-d4ed789e-d55d-4058-b853-b7823b426b89 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] [instance: b1a612df-55d1-4106-951d-7f0ea95cfe83] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:26:59.700635 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-d4ed789e-d55d-4058-b853-b7823b426b89 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:26:59.702290 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-d4ed789e-d55d-4058-b853-b7823b426b89 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:26:59.703302 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-d4ed789e-d55d-4058-b853-b7823b426b89 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:26:59.703903 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-d4ed789e-d55d-4058-b853-b7823b426b89 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:26:59.818590 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-d4d36fe3-c075-4dee-a4ba-7b7468300375 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:26:59.818590 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-d4d36fe3-c075-4dee-a4ba-7b7468300375 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] [instance: 9333850c-071c-4330-98b9-84232a752ffe] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:26:59.873891 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-d4ed789e-d55d-4058-b853-b7823b426b89 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8f887f5689419e9e31a0ba43f76ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62d19c831574f9b99c993b5e41c645d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:26:59.892718 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-d4ed789e-d55d-4058-b853-b7823b426b89 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] 10.222.0.46 "GET /compute/v2.1/servers/b1a612df-55d1-4106-951d-7f0ea95cfe83" status: 200 len: 1522 microversion: 2.1 time: 0.233879 Aug 04 05:26:59.894699 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 104/206] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:26:59 2022] GET /compute/v2.1/servers/b1a612df-55d1-4106-951d-7f0ea95cfe83 => generated 1522 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:26:59.922691 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-d4d36fe3-c075-4dee-a4ba-7b7468300375 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb4dea95659c473b9b193c6234186430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1ca4b83dc874bda9f33e06f4910608c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:27:00.249606 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-d4d36fe3-c075-4dee-a4ba-7b7468300375 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] 10.222.0.46 "GET /compute/v2.1/servers/9333850c-071c-4330-98b9-84232a752ffe" status: 200 len: 1238 microversion: 2.1 time: 0.438311 Aug 04 05:27:00.250386 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 103/207] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:26:59 2022] GET /compute/v2.1/servers/9333850c-071c-4330-98b9-84232a752ffe => generated 1238 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:27:00.921073 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-8277a167-c603-480b-9fa6-bff4defedc13 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:27:00.924785 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-8277a167-c603-480b-9fa6-bff4defedc13 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] [instance: b1a612df-55d1-4106-951d-7f0ea95cfe83] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:27:00.943659 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-8277a167-c603-480b-9fa6-bff4defedc13 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:27:00.944476 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-8277a167-c603-480b-9fa6-bff4defedc13 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:27:00.945548 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-8277a167-c603-480b-9fa6-bff4defedc13 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:27:00.946267 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-8277a167-c603-480b-9fa6-bff4defedc13 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:27:00.953392 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG dbcounter [-] [118477] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:27:01.206550 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-8277a167-c603-480b-9fa6-bff4defedc13 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8f887f5689419e9e31a0ba43f76ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62d19c831574f9b99c993b5e41c645d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:27:01.217377 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-8277a167-c603-480b-9fa6-bff4defedc13 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] 10.222.0.46 "GET /compute/v2.1/servers/b1a612df-55d1-4106-951d-7f0ea95cfe83" status: 200 len: 1522 microversion: 2.1 time: 0.300102 Aug 04 05:27:01.218526 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 105/208] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:27:00 2022] GET /compute/v2.1/servers/b1a612df-55d1-4106-951d-7f0ea95cfe83 => generated 1522 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:27:01.278873 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-c7eecd1f-33fa-48cc-a0c4-94b28e1ff05b tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:27:01.279727 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-c7eecd1f-33fa-48cc-a0c4-94b28e1ff05b tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] [instance: 9333850c-071c-4330-98b9-84232a752ffe] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:27:01.292890 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-c7eecd1f-33fa-48cc-a0c4-94b28e1ff05b tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:27:01.293418 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-c7eecd1f-33fa-48cc-a0c4-94b28e1ff05b tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:27:01.299411 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-c7eecd1f-33fa-48cc-a0c4-94b28e1ff05b tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:27:01.299916 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-c7eecd1f-33fa-48cc-a0c4-94b28e1ff05b tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:27:01.475573 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-c7eecd1f-33fa-48cc-a0c4-94b28e1ff05b tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb4dea95659c473b9b193c6234186430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1ca4b83dc874bda9f33e06f4910608c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:27:01.484781 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-c7eecd1f-33fa-48cc-a0c4-94b28e1ff05b tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] 10.222.0.46 "GET /compute/v2.1/servers/9333850c-071c-4330-98b9-84232a752ffe" status: 200 len: 1242 microversion: 2.1 time: 0.216980 Aug 04 05:27:01.486044 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 104/209] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:27:01 2022] GET /compute/v2.1/servers/9333850c-071c-4330-98b9-84232a752ffe => generated 1242 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:27:02.247253 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-a66474bd-a04c-4b3d-8d9b-b9ac3630ea6f tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:27:02.247253 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-a66474bd-a04c-4b3d-8d9b-b9ac3630ea6f tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] [instance: b1a612df-55d1-4106-951d-7f0ea95cfe83] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:27:02.252302 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-a66474bd-a04c-4b3d-8d9b-b9ac3630ea6f tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:27:02.255922 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-a66474bd-a04c-4b3d-8d9b-b9ac3630ea6f tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:27:02.259088 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-a66474bd-a04c-4b3d-8d9b-b9ac3630ea6f tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:27:02.259894 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-a66474bd-a04c-4b3d-8d9b-b9ac3630ea6f tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:27:02.508369 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-37a96de7-79fe-4d8b-89a3-e010f1700c97 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:27:02.508981 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-37a96de7-79fe-4d8b-89a3-e010f1700c97 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] [instance: 9333850c-071c-4330-98b9-84232a752ffe] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:27:02.521296 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-37a96de7-79fe-4d8b-89a3-e010f1700c97 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:27:02.522169 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-37a96de7-79fe-4d8b-89a3-e010f1700c97 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:27:02.523092 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-37a96de7-79fe-4d8b-89a3-e010f1700c97 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:27:02.523716 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-37a96de7-79fe-4d8b-89a3-e010f1700c97 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:27:02.800406 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-37a96de7-79fe-4d8b-89a3-e010f1700c97 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb4dea95659c473b9b193c6234186430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1ca4b83dc874bda9f33e06f4910608c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:27:02.820415 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-37a96de7-79fe-4d8b-89a3-e010f1700c97 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] 10.222.0.46 "GET /compute/v2.1/servers/9333850c-071c-4330-98b9-84232a752ffe" status: 200 len: 1290 microversion: 2.1 time: 0.305738 Aug 04 05:27:02.821199 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 105/210] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:27:02 2022] GET /compute/v2.1/servers/9333850c-071c-4330-98b9-84232a752ffe => generated 1290 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 05:27:03.073608 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-a66474bd-a04c-4b3d-8d9b-b9ac3630ea6f tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8f887f5689419e9e31a0ba43f76ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62d19c831574f9b99c993b5e41c645d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:27:03.083098 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-a66474bd-a04c-4b3d-8d9b-b9ac3630ea6f tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] 10.222.0.46 "GET /compute/v2.1/servers/b1a612df-55d1-4106-951d-7f0ea95cfe83" status: 200 len: 1522 microversion: 2.1 time: 0.845965 Aug 04 05:27:03.104833 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 106/211] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:27:02 2022] GET /compute/v2.1/servers/b1a612df-55d1-4106-951d-7f0ea95cfe83 => generated 1522 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:27:03.847236 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-9ef4b493-b840-4b51-84e8-806967075162 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:27:03.848659 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-9ef4b493-b840-4b51-84e8-806967075162 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] [instance: 9333850c-071c-4330-98b9-84232a752ffe] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:27:03.860689 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-9ef4b493-b840-4b51-84e8-806967075162 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:27:03.861239 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-9ef4b493-b840-4b51-84e8-806967075162 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:27:03.862049 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-9ef4b493-b840-4b51-84e8-806967075162 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:27:03.862973 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-9ef4b493-b840-4b51-84e8-806967075162 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:27:03.980788 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-9ef4b493-b840-4b51-84e8-806967075162 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb4dea95659c473b9b193c6234186430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1ca4b83dc874bda9f33e06f4910608c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:27:03.996279 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-9ef4b493-b840-4b51-84e8-806967075162 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] 10.222.0.46 "GET /compute/v2.1/servers/9333850c-071c-4330-98b9-84232a752ffe" status: 200 len: 1296 microversion: 2.1 time: 0.153460 Aug 04 05:27:04.006915 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 106/212] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:27:03 2022] GET /compute/v2.1/servers/9333850c-071c-4330-98b9-84232a752ffe => generated 1296 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:27:04.142743 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-c75caefa-8e5e-4e5e-9ac8-578b44355cf4 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:27:04.144368 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-c75caefa-8e5e-4e5e-9ac8-578b44355cf4 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] [instance: b1a612df-55d1-4106-951d-7f0ea95cfe83] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:27:04.165002 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-c75caefa-8e5e-4e5e-9ac8-578b44355cf4 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:27:04.172054 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-c75caefa-8e5e-4e5e-9ac8-578b44355cf4 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:27:04.185077 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-c75caefa-8e5e-4e5e-9ac8-578b44355cf4 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:27:04.185077 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-c75caefa-8e5e-4e5e-9ac8-578b44355cf4 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:27:04.922910 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-c75caefa-8e5e-4e5e-9ac8-578b44355cf4 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8f887f5689419e9e31a0ba43f76ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62d19c831574f9b99c993b5e41c645d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:27:04.931757 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-c75caefa-8e5e-4e5e-9ac8-578b44355cf4 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] 10.222.0.46 "GET /compute/v2.1/servers/b1a612df-55d1-4106-951d-7f0ea95cfe83" status: 200 len: 1522 microversion: 2.1 time: 0.812422 Aug 04 05:27:04.935271 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 107/213] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:27:04 2022] GET /compute/v2.1/servers/b1a612df-55d1-4106-951d-7f0ea95cfe83 => generated 1522 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:27:05.025119 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-e8148978-ed06-45d5-89ca-114b07efb19f tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:27:05.028104 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-e8148978-ed06-45d5-89ca-114b07efb19f tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] [instance: 9333850c-071c-4330-98b9-84232a752ffe] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:27:05.047470 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-e8148978-ed06-45d5-89ca-114b07efb19f tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:27:05.048305 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-e8148978-ed06-45d5-89ca-114b07efb19f tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:27:05.049818 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-e8148978-ed06-45d5-89ca-114b07efb19f tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:27:05.055564 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-e8148978-ed06-45d5-89ca-114b07efb19f tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:27:05.354784 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-e8148978-ed06-45d5-89ca-114b07efb19f tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb4dea95659c473b9b193c6234186430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1ca4b83dc874bda9f33e06f4910608c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:27:05.372059 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-e8148978-ed06-45d5-89ca-114b07efb19f tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] 10.222.0.46 "GET /compute/v2.1/servers/9333850c-071c-4330-98b9-84232a752ffe" status: 200 len: 1363 microversion: 2.1 time: 0.354159 Aug 04 05:27:05.372766 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 107/214] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:27:05 2022] GET /compute/v2.1/servers/9333850c-071c-4330-98b9-84232a752ffe => generated 1363 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:27:05.963297 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-7d15b972-5ec1-4310-a415-d29b3fcb3f03 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:27:05.965011 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-7d15b972-5ec1-4310-a415-d29b3fcb3f03 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] [instance: b1a612df-55d1-4106-951d-7f0ea95cfe83] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:27:05.978487 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-7d15b972-5ec1-4310-a415-d29b3fcb3f03 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:27:05.979248 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-7d15b972-5ec1-4310-a415-d29b3fcb3f03 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:27:05.980273 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-7d15b972-5ec1-4310-a415-d29b3fcb3f03 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:27:05.981594 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-7d15b972-5ec1-4310-a415-d29b3fcb3f03 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:27:05.983632 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [req-b3f8197b-9ba1-42fe-9e1e-4950e1c4a723 req-d5a4622e-c1a9-4ae6-a154-9611c5b1cf49 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9333850c-071c-4330-98b9-84232a752ffe", "tag": "4660aa79-5e1b-4fcd-8608-50d5264cea3e"}]} {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:27:06.005941 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [req-b3f8197b-9ba1-42fe-9e1e-4950e1c4a723 req-d5a4622e-c1a9-4ae6-a154-9611c5b1cf49 service nova] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:27:06.006329 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [req-b3f8197b-9ba1-42fe-9e1e-4950e1c4a723 req-d5a4622e-c1a9-4ae6-a154-9611c5b1cf49 service nova] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:27:06.010921 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG dbcounter [-] [118476] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:27:06.029379 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.compute.server_external_events [req-b3f8197b-9ba1-42fe-9e1e-4950e1c4a723 req-d5a4622e-c1a9-4ae6-a154-9611c5b1cf49 service nova] Creating event network-changed:4660aa79-5e1b-4fcd-8608-50d5264cea3e for instance 9333850c-071c-4330-98b9-84232a752ffe on hv-cinder-85207 Aug 04 05:27:06.041058 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [req-b3f8197b-9ba1-42fe-9e1e-4950e1c4a723 req-d5a4622e-c1a9-4ae6-a154-9611c5b1cf49 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060489 Aug 04 05:27:06.044039 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 108/215] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Aug 4 05:27:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 05:27:06.396871 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-4b3c7f47-2d24-4e01-8e28-2fbdcd1af038 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:27:06.398551 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-7d15b972-5ec1-4310-a415-d29b3fcb3f03 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8f887f5689419e9e31a0ba43f76ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62d19c831574f9b99c993b5e41c645d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:27:06.399046 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-4b3c7f47-2d24-4e01-8e28-2fbdcd1af038 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] [instance: 9333850c-071c-4330-98b9-84232a752ffe] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:27:06.422338 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-7d15b972-5ec1-4310-a415-d29b3fcb3f03 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] 10.222.0.46 "GET /compute/v2.1/servers/b1a612df-55d1-4106-951d-7f0ea95cfe83" status: 200 len: 1522 microversion: 2.1 time: 0.458576 Aug 04 05:27:06.422446 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-4b3c7f47-2d24-4e01-8e28-2fbdcd1af038 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:27:06.422446 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-4b3c7f47-2d24-4e01-8e28-2fbdcd1af038 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:27:06.422446 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-4b3c7f47-2d24-4e01-8e28-2fbdcd1af038 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:27:06.422446 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-4b3c7f47-2d24-4e01-8e28-2fbdcd1af038 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:27:06.430040 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 108/216] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:27:05 2022] GET /compute/v2.1/servers/b1a612df-55d1-4106-951d-7f0ea95cfe83 => generated 1522 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:27:06.697702 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-4b3c7f47-2d24-4e01-8e28-2fbdcd1af038 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb4dea95659c473b9b193c6234186430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1ca4b83dc874bda9f33e06f4910608c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:27:06.721136 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-4b3c7f47-2d24-4e01-8e28-2fbdcd1af038 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] 10.222.0.46 "GET /compute/v2.1/servers/9333850c-071c-4330-98b9-84232a752ffe" status: 200 len: 1363 microversion: 2.1 time: 0.317441 Aug 04 05:27:06.738535 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 109/217] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:27:06 2022] GET /compute/v2.1/servers/9333850c-071c-4330-98b9-84232a752ffe => generated 1363 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 05:27:07.449977 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-9dd3b3e7-cb53-4476-8e42-2cf4d376f288 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:27:07.460111 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-9dd3b3e7-cb53-4476-8e42-2cf4d376f288 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] [instance: b1a612df-55d1-4106-951d-7f0ea95cfe83] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:27:07.473912 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-9dd3b3e7-cb53-4476-8e42-2cf4d376f288 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:27:07.474390 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-9dd3b3e7-cb53-4476-8e42-2cf4d376f288 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:27:07.475200 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-9dd3b3e7-cb53-4476-8e42-2cf4d376f288 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:27:07.475605 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-9dd3b3e7-cb53-4476-8e42-2cf4d376f288 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:27:07.751213 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-433c883d-f8f7-4a84-9930-978148101f92 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:27:07.752704 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-433c883d-f8f7-4a84-9930-978148101f92 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] [instance: 9333850c-071c-4330-98b9-84232a752ffe] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:27:07.771844 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-433c883d-f8f7-4a84-9930-978148101f92 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:27:07.772422 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-433c883d-f8f7-4a84-9930-978148101f92 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:27:07.775032 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-433c883d-f8f7-4a84-9930-978148101f92 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:27:07.778000 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-433c883d-f8f7-4a84-9930-978148101f92 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:27:07.804608 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-9dd3b3e7-cb53-4476-8e42-2cf4d376f288 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8f887f5689419e9e31a0ba43f76ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62d19c831574f9b99c993b5e41c645d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:27:07.813137 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-9dd3b3e7-cb53-4476-8e42-2cf4d376f288 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] 10.222.0.46 "GET /compute/v2.1/servers/b1a612df-55d1-4106-951d-7f0ea95cfe83" status: 200 len: 1522 microversion: 2.1 time: 0.377474 Aug 04 05:27:07.815098 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 109/218] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:27:07 2022] GET /compute/v2.1/servers/b1a612df-55d1-4106-951d-7f0ea95cfe83 => generated 1522 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:27:08.178785 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-433c883d-f8f7-4a84-9930-978148101f92 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb4dea95659c473b9b193c6234186430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1ca4b83dc874bda9f33e06f4910608c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:27:08.208660 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-433c883d-f8f7-4a84-9930-978148101f92 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] 10.222.0.46 "GET /compute/v2.1/servers/9333850c-071c-4330-98b9-84232a752ffe" status: 200 len: 1363 microversion: 2.1 time: 0.464333 Aug 04 05:27:08.210368 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 110/219] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:27:07 2022] GET /compute/v2.1/servers/9333850c-071c-4330-98b9-84232a752ffe => generated 1363 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:27:08.841734 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-3eaff774-578f-485e-b5b3-98090bc6e3c3 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:27:08.842418 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-3eaff774-578f-485e-b5b3-98090bc6e3c3 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] [instance: b1a612df-55d1-4106-951d-7f0ea95cfe83] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:27:08.885288 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG dbcounter [-] [118477] Writing DB stats nova_cell0:SELECT=2 {{(pid=118477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:27:08.886621 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG dbcounter [-] [118477] Writing DB stats nova_cell0:SELECT=10 {{(pid=118477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:27:08.887307 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG dbcounter [-] [118477] Writing DB stats nova_api:SELECT=54,nova_api:INSERT=4 {{(pid=118477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:27:08.897016 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-3eaff774-578f-485e-b5b3-98090bc6e3c3 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:27:08.897258 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-3eaff774-578f-485e-b5b3-98090bc6e3c3 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:27:08.905494 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-3eaff774-578f-485e-b5b3-98090bc6e3c3 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:27:08.905955 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-3eaff774-578f-485e-b5b3-98090bc6e3c3 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:27:08.961731 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-31148511-1137-4934-91ce-dbdb78c6dba0 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Action: 'create', calling method: .version_select at 0x7f1476170310>, body: {"keypair": {"name": "tempest-keypair-1764646286", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPsdT3PRbkz+LPtWqD+IMsHwF9IJ1XYyIrNDoo+lYuSr6opywMNH8sYMLcqpXUV4JU+mEOZXACm6NxyWaAKULBxA/IS9fSxO94r/OiZ33RDdHgYyl5fIF7dZeYNVKVFqhg=="}} {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:27:09.020391 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.quota [None req-31148511-1137-4934-91ce-dbdb78c6dba0 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Getting quotas for project faead990837d43de8ec54bfaf24361de. Resources: {'key_pairs'} {{(pid=118476) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 05:27:09.038774 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.quota [None req-31148511-1137-4934-91ce-dbdb78c6dba0 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Getting quotas for user 9cb49b631c234f9a9fd47049b9b2e097 and project faead990837d43de8ec54bfaf24361de. Resources: {'key_pairs'} {{(pid=118476) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 05:27:09.241967 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-31148511-1137-4934-91ce-dbdb78c6dba0 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.289522 Aug 04 05:27:09.242653 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 111/220] 10.222.0.46 () {60 vars in 1159 bytes} [Thu Aug 4 05:27:08 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:27:09.255500 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-2cabc12f-7ba4-4ff9-ab5f-3ff601643b1d tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:27:09.264815 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-2cabc12f-7ba4-4ff9-ab5f-3ff601643b1d tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] [instance: 9333850c-071c-4330-98b9-84232a752ffe] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:27:09.298528 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-2cabc12f-7ba4-4ff9-ab5f-3ff601643b1d tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:27:09.300030 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-2cabc12f-7ba4-4ff9-ab5f-3ff601643b1d tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:27:09.302385 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-2cabc12f-7ba4-4ff9-ab5f-3ff601643b1d tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:27:09.302978 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-2cabc12f-7ba4-4ff9-ab5f-3ff601643b1d tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:27:09.812074 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-3eaff774-578f-485e-b5b3-98090bc6e3c3 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8f887f5689419e9e31a0ba43f76ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62d19c831574f9b99c993b5e41c645d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:27:09.828758 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-3eaff774-578f-485e-b5b3-98090bc6e3c3 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] 10.222.0.46 "GET /compute/v2.1/servers/b1a612df-55d1-4106-951d-7f0ea95cfe83" status: 200 len: 1522 microversion: 2.1 time: 0.993113 Aug 04 05:27:09.843539 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 110/221] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:27:08 2022] GET /compute/v2.1/servers/b1a612df-55d1-4106-951d-7f0ea95cfe83 => generated 1522 bytes in 1009 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:27:10.171177 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-801bb50c-79ac-4a5f-ae9c-753a3c2e7195 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Action: 'create', calling method: .version_select at 0x7f14756ca940>, body: {"keypair": {"name": "tempest-TestShelveInstance-564503341", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBINAuT567J8QFSIBt4cA/TGJuPsgUxzp62g5CikraAENpC0vo6ezPVlU0WEKjhwJFYKdv6KxXcPVx1UzXucMwkt4t4PygP2Uuvkw01B8Cjm/JW3r1CRXN8nWx9YYSFJQIA=="}} {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:27:10.213664 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.quota [None req-801bb50c-79ac-4a5f-ae9c-753a3c2e7195 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Getting quotas for project e32569df1dca45cebcdd63d03ff5abae. Resources: {'key_pairs'} {{(pid=118477) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 05:27:10.225555 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.quota [None req-801bb50c-79ac-4a5f-ae9c-753a3c2e7195 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Getting quotas for user 965cf2aad5bc4def9fca55aac87cc37e and project e32569df1dca45cebcdd63d03ff5abae. Resources: {'key_pairs'} {{(pid=118477) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 05:27:10.282387 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-2cabc12f-7ba4-4ff9-ab5f-3ff601643b1d tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb4dea95659c473b9b193c6234186430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1ca4b83dc874bda9f33e06f4910608c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:27:10.299860 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-2cabc12f-7ba4-4ff9-ab5f-3ff601643b1d tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] 10.222.0.46 "GET /compute/v2.1/servers/9333850c-071c-4330-98b9-84232a752ffe" status: 200 len: 1363 microversion: 2.1 time: 1.052794 Aug 04 05:27:10.301263 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 112/222] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:27:09 2022] GET /compute/v2.1/servers/9333850c-071c-4330-98b9-84232a752ffe => generated 1363 bytes in 1056 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:27:10.361427 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-801bb50c-79ac-4a5f-ae9c-753a3c2e7195 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.511415 Aug 04 05:27:10.368090 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 111/223] 10.222.0.46 () {60 vars in 1159 bytes} [Thu Aug 4 05:27:09 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:27:10.867130 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-856d589b-52fe-4552-9b91-fac5b9565705 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:27:10.867754 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-856d589b-52fe-4552-9b91-fac5b9565705 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] [instance: b1a612df-55d1-4106-951d-7f0ea95cfe83] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:27:10.893396 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-856d589b-52fe-4552-9b91-fac5b9565705 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:27:10.893851 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-856d589b-52fe-4552-9b91-fac5b9565705 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:27:10.897362 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-856d589b-52fe-4552-9b91-fac5b9565705 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:27:10.899108 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-856d589b-52fe-4552-9b91-fac5b9565705 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:27:11.263503 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-856d589b-52fe-4552-9b91-fac5b9565705 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8f887f5689419e9e31a0ba43f76ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62d19c831574f9b99c993b5e41c645d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:27:11.274338 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-856d589b-52fe-4552-9b91-fac5b9565705 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] 10.222.0.46 "GET /compute/v2.1/servers/b1a612df-55d1-4106-951d-7f0ea95cfe83" status: 200 len: 1522 microversion: 2.1 time: 0.417882 Aug 04 05:27:11.276063 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 113/224] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:27:10 2022] GET /compute/v2.1/servers/b1a612df-55d1-4106-951d-7f0ea95cfe83 => generated 1522 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:27:11.324612 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-3bc43d95-93f7-4bf6-8beb-34c7af4c6720 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:27:11.325391 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-3bc43d95-93f7-4bf6-8beb-34c7af4c6720 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] [instance: 9333850c-071c-4330-98b9-84232a752ffe] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:27:11.332906 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-3bc43d95-93f7-4bf6-8beb-34c7af4c6720 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:27:11.333608 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-3bc43d95-93f7-4bf6-8beb-34c7af4c6720 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:27:11.334595 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-3bc43d95-93f7-4bf6-8beb-34c7af4c6720 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:27:11.340480 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-3bc43d95-93f7-4bf6-8beb-34c7af4c6720 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:27:11.702725 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-3bc43d95-93f7-4bf6-8beb-34c7af4c6720 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb4dea95659c473b9b193c6234186430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1ca4b83dc874bda9f33e06f4910608c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:27:11.717677 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-3bc43d95-93f7-4bf6-8beb-34c7af4c6720 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] 10.222.0.46 "GET /compute/v2.1/servers/9333850c-071c-4330-98b9-84232a752ffe" status: 200 len: 1363 microversion: 2.1 time: 0.397530 Aug 04 05:27:11.722289 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 112/225] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:27:11 2022] GET /compute/v2.1/servers/9333850c-071c-4330-98b9-84232a752ffe => generated 1363 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:27:12.299188 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-74b85e10-b770-4ad2-860e-f6990834d9b9 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:27:12.303031 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-74b85e10-b770-4ad2-860e-f6990834d9b9 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] [instance: b1a612df-55d1-4106-951d-7f0ea95cfe83] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:27:12.313948 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-74b85e10-b770-4ad2-860e-f6990834d9b9 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:27:12.313948 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-74b85e10-b770-4ad2-860e-f6990834d9b9 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:27:12.313948 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-74b85e10-b770-4ad2-860e-f6990834d9b9 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:27:12.313948 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-74b85e10-b770-4ad2-860e-f6990834d9b9 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:27:12.454901 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-74b85e10-b770-4ad2-860e-f6990834d9b9 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8f887f5689419e9e31a0ba43f76ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62d19c831574f9b99c993b5e41c645d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:27:12.462891 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-74b85e10-b770-4ad2-860e-f6990834d9b9 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] 10.222.0.46 "GET /compute/v2.1/servers/b1a612df-55d1-4106-951d-7f0ea95cfe83" status: 200 len: 1502 microversion: 2.1 time: 0.169182 Aug 04 05:27:12.463485 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 114/226] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:27:12 2022] GET /compute/v2.1/servers/b1a612df-55d1-4106-951d-7f0ea95cfe83 => generated 1502 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:27:12.484635 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-57234736-f49d-4250-810f-7b16c8f22608 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "af28ebc3-8809-4076-926b-b0fea363b16e"}} {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:27:12.491441 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-57234736-f49d-4250-810f-7b16c8f22608 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] [instance: b1a612df-55d1-4106-951d-7f0ea95cfe83] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:27:12.504893 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-57234736-f49d-4250-810f-7b16c8f22608 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:27:12.506074 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-57234736-f49d-4250-810f-7b16c8f22608 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:27:12.507044 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-57234736-f49d-4250-810f-7b16c8f22608 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:27:12.507616 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-57234736-f49d-4250-810f-7b16c8f22608 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:27:12.559521 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.wsgi [None req-57234736-f49d-4250-810f-7b16c8f22608 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] HTTP exception thrown: Cannot 'attach_volume' instance b1a612df-55d1-4106-951d-7f0ea95cfe83 while it is in vm_state rescued Aug 04 05:27:12.563160 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-57234736-f49d-4250-810f-7b16c8f22608 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Request method failure captured: Aug 04 05:27:12.563160 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: request: POST /compute/v2.1/servers/b1a612df-55d1-4106-951d-7f0ea95cfe83/os-volume_attachments HTTP/1.1 Aug 04 05:27:12.563160 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: Accept: application/json Aug 04 05:27:12.563160 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: Accept-Encoding: identity Aug 04 05:27:12.563160 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: Connection: close Aug 04 05:27:12.563160 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: Content-Length: 74 Aug 04 05:27:12.563160 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: Content-Type: application/json Aug 04 05:27:12.563160 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: Host: 10.222.0.46 Aug 04 05:27:12.563160 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: Openstack-System-Scope: None Aug 04 05:27:12.563160 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: User-Agent: python-urllib3/1.26.11 Aug 04 05:27:12.563160 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Auth-Token: gAAAAABi61g53OabLgO4gW69xhev3-hVAHcOcUE9Y2w5YBGtgFfk0SOjtoLwecmlrXgTD_O28rN04Wx-xl4rDlr6cEau3Mp5S6ihh8QrLzUUzoS_WNUMRZYqOqiUmHYH7qSat4VCjMgYwUWTzg9zUzn68Xb9K2m9ofVkhx1oUsZEWZ2JuoREn50 Aug 04 05:27:12.563160 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Domain-Id: None Aug 04 05:27:12.563160 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Domain-Name: None Aug 04 05:27:12.563160 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Identity-Status: Confirmed Aug 04 05:27:12.563160 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Is-Admin-Project: True Aug 04 05:27:12.563160 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Project-Domain-Id: default Aug 04 05:27:12.563160 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Project-Domain-Name: Default Aug 04 05:27:12.563160 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Project-Id: b62d19c831574f9b99c993b5e41c645d Aug 04 05:27:12.563160 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1543928594 Aug 04 05:27:12.563160 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Role: member,reader Aug 04 05:27:12.563160 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Roles: member,reader Aug 04 05:27:12.564671 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/b62d19c831574f9b99c993b5e41c645d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/b62d19c831574f9b99c993b5e41c645d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_b62d19c831574f9b99c993b5e41c645d", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/b62d19c831574f9b99c993b5e41c645d"}]}] Aug 04 05:27:12.564671 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1543928594 Aug 04 05:27:12.564671 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Tenant-Id: b62d19c831574f9b99c993b5e41c645d Aug 04 05:27:12.564671 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1543928594 Aug 04 05:27:12.564671 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-User: tempest-ServerRescueNegativeTestJSON-1543928594-project Aug 04 05:27:12.564671 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-User-Domain-Id: default Aug 04 05:27:12.564671 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-User-Domain-Name: Default Aug 04 05:27:12.564671 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-User-Id: ab8f887f5689419e9e31a0ba43f76ada Aug 04 05:27:12.564671 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1543928594-project Aug 04 05:27:12.564671 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: Aug 04 05:27:12.564671 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: {"volumeAttachment": {"volumeId": "af28ebc3-8809-4076-926b-b0fea363b16e"}} Aug 04 05:27:12.564671 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: method: > Aug 04 05:27:12.565551 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: exception: Cannot 'attach_volume' instance b1a612df-55d1-4106-951d-7f0ea95cfe83 while it is in vm_state rescued Aug 04 05:27:12.565551 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: action_args: {'server_id': 'b1a612df-55d1-4106-951d-7f0ea95cfe83', 'body': {'volumeAttachment': {'volumeId': 'af28ebc3-8809-4076-926b-b0fea363b16e'}}} Aug 04 05:27:12.565551 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 05:27:12.565551 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:27:12.565551 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 04 05:27:12.565551 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 04 05:27:12.565551 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 04 05:27:12.565551 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 04 05:27:12.565551 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 04 05:27:12.565551 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 04 05:27:12.565551 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance b1a612df-55d1-4106-951d-7f0ea95cfe83 in vm_state rescued. Cannot attach_volume while the instance is in this state. Aug 04 05:27:12.565551 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Aug 04 05:27:12.565551 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:27:12.565551 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Aug 04 05:27:12.565551 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:27:12.565551 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:27:12.565551 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:27:12.565551 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 05:27:12.565551 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 05:27:12.566975 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 05:27:12.566975 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 05:27:12.566975 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 05:27:12.566975 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 05:27:12.566975 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 05:27:12.566975 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 05:27:12.566975 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 05:27:12.566975 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 05:27:12.566975 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Aug 04 05:27:12.566975 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 04 05:27:12.566975 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 04 05:27:12.566975 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 04 05:27:12.566975 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance b1a612df-55d1-4106-951d-7f0ea95cfe83 while it is in vm_state rescued Aug 04 05:27:12.566975 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Aug 04 05:27:12.566975 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:27:12.566975 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Aug 04 05:27:12.566975 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:27:12.566975 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:27:12.566975 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:27:12.568265 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 05:27:12.568265 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 05:27:12.568265 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance b1a612df-55d1-4106-951d-7f0ea95cfe83 while it is in vm_state rescued Aug 04 05:27:12.568265 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Aug 04 05:27:12.569921 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-57234736-f49d-4250-810f-7b16c8f22608 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Returning 409 to user: Cannot 'attach_volume' instance b1a612df-55d1-4106-951d-7f0ea95cfe83 while it is in vm_state rescued {{(pid=118477) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 05:27:12.571000 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-57234736-f49d-4250-810f-7b16c8f22608 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] 10.222.0.46 "POST /compute/v2.1/servers/b1a612df-55d1-4106-951d-7f0ea95cfe83/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.090769 Aug 04 05:27:12.571680 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 113/227] 10.222.0.46 () {60 vars in 1323 bytes} [Thu Aug 4 05:27:12 2022] POST /compute/v2.1/servers/b1a612df-55d1-4106-951d-7f0ea95cfe83/os-volume_attachments => generated 152 bytes in 92 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 04 05:27:12.581489 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-ec7df123-7043-4d2b-9ac2-c7a50fbbdfd4 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:27:12.582394 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-ec7df123-7043-4d2b-9ac2-c7a50fbbdfd4 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] [instance: b1a612df-55d1-4106-951d-7f0ea95cfe83] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:27:12.590830 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-ec7df123-7043-4d2b-9ac2-c7a50fbbdfd4 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:27:12.596590 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-ec7df123-7043-4d2b-9ac2-c7a50fbbdfd4 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:27:12.596590 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-ec7df123-7043-4d2b-9ac2-c7a50fbbdfd4 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:27:12.596590 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-ec7df123-7043-4d2b-9ac2-c7a50fbbdfd4 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:27:12.750147 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-04021351-379a-444e-870a-8cd1e9fb2acf tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:27:12.750793 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-04021351-379a-444e-870a-8cd1e9fb2acf tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] [instance: 9333850c-071c-4330-98b9-84232a752ffe] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:27:12.757603 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-04021351-379a-444e-870a-8cd1e9fb2acf tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:27:12.758170 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-04021351-379a-444e-870a-8cd1e9fb2acf tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:27:12.759928 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-04021351-379a-444e-870a-8cd1e9fb2acf tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:27:12.759928 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-04021351-379a-444e-870a-8cd1e9fb2acf tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:27:12.900770 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-ec7df123-7043-4d2b-9ac2-c7a50fbbdfd4 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] 10.222.0.46 "POST /compute/v2.1/servers/b1a612df-55d1-4106-951d-7f0ea95cfe83/action" status: 202 len: 0 microversion: 2.1 time: 0.321299 Aug 04 05:27:12.901016 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 115/228] 10.222.0.46 () {60 vars in 1278 bytes} [Thu Aug 4 05:27:12 2022] POST /compute/v2.1/servers/b1a612df-55d1-4106-951d-7f0ea95cfe83/action => generated 0 bytes in 324 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 05:27:12.908825 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-104b8329-ba9f-41f4-b93a-b6104d7ebea5 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:27:12.919176 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-104b8329-ba9f-41f4-b93a-b6104d7ebea5 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] [instance: b1a612df-55d1-4106-951d-7f0ea95cfe83] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:27:12.934131 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-104b8329-ba9f-41f4-b93a-b6104d7ebea5 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:27:12.937711 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-104b8329-ba9f-41f4-b93a-b6104d7ebea5 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:27:12.938934 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-104b8329-ba9f-41f4-b93a-b6104d7ebea5 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:27:12.939604 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-104b8329-ba9f-41f4-b93a-b6104d7ebea5 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:27:13.067488 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-04021351-379a-444e-870a-8cd1e9fb2acf tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb4dea95659c473b9b193c6234186430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1ca4b83dc874bda9f33e06f4910608c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:27:13.076992 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-04021351-379a-444e-870a-8cd1e9fb2acf tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] 10.222.0.46 "GET /compute/v2.1/servers/9333850c-071c-4330-98b9-84232a752ffe" status: 200 len: 1363 microversion: 2.1 time: 0.330613 Aug 04 05:27:13.077493 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 114/229] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:27:12 2022] GET /compute/v2.1/servers/9333850c-071c-4330-98b9-84232a752ffe => generated 1363 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:27:13.139335 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [req-014bf3d7-6dfa-4f3c-a405-340b718700ae req-368899b6-24ca-463a-9fa4-e7638fa8d399 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9333850c-071c-4330-98b9-84232a752ffe", "name": "network-vif-plugged", "status": "completed", "tag": "4660aa79-5e1b-4fcd-8608-50d5264cea3e"}]} {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:27:13.157123 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [req-014bf3d7-6dfa-4f3c-a405-340b718700ae req-368899b6-24ca-463a-9fa4-e7638fa8d399 service nova] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:27:13.157783 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [req-014bf3d7-6dfa-4f3c-a405-340b718700ae req-368899b6-24ca-463a-9fa4-e7638fa8d399 service nova] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:27:13.187867 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.compute.server_external_events [req-014bf3d7-6dfa-4f3c-a405-340b718700ae req-368899b6-24ca-463a-9fa4-e7638fa8d399 service nova] Creating event network-vif-plugged:4660aa79-5e1b-4fcd-8608-50d5264cea3e for instance 9333850c-071c-4330-98b9-84232a752ffe on hv-cinder-85207 Aug 04 05:27:13.199983 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [req-014bf3d7-6dfa-4f3c-a405-340b718700ae req-368899b6-24ca-463a-9fa4-e7638fa8d399 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064441 Aug 04 05:27:13.200674 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 115/230] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Aug 4 05:27:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:27:13.233965 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-104b8329-ba9f-41f4-b93a-b6104d7ebea5 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8f887f5689419e9e31a0ba43f76ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62d19c831574f9b99c993b5e41c645d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:27:13.245663 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-104b8329-ba9f-41f4-b93a-b6104d7ebea5 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] 10.222.0.46 "GET /compute/v2.1/servers/b1a612df-55d1-4106-951d-7f0ea95cfe83" status: 200 len: 1510 microversion: 2.1 time: 0.341102 Aug 04 05:27:13.249374 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 116/231] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:27:12 2022] GET /compute/v2.1/servers/b1a612df-55d1-4106-951d-7f0ea95cfe83 => generated 1510 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:27:14.099985 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-8073960f-e131-4369-adf0-cf8dc9ef55ef tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:27:14.100694 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-8073960f-e131-4369-adf0-cf8dc9ef55ef tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] [instance: 9333850c-071c-4330-98b9-84232a752ffe] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:27:14.113411 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-8073960f-e131-4369-adf0-cf8dc9ef55ef tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:27:14.114194 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-8073960f-e131-4369-adf0-cf8dc9ef55ef tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:27:14.115187 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-8073960f-e131-4369-adf0-cf8dc9ef55ef tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:27:14.116219 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-8073960f-e131-4369-adf0-cf8dc9ef55ef tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:27:14.271636 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-18e34ab6-c90b-4092-823c-e5c115742f57 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:27:14.272891 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-18e34ab6-c90b-4092-823c-e5c115742f57 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] [instance: b1a612df-55d1-4106-951d-7f0ea95cfe83] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:27:14.282539 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-18e34ab6-c90b-4092-823c-e5c115742f57 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:27:14.283304 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-18e34ab6-c90b-4092-823c-e5c115742f57 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:27:14.284920 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-18e34ab6-c90b-4092-823c-e5c115742f57 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:27:14.285549 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-18e34ab6-c90b-4092-823c-e5c115742f57 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:27:14.329776 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-8073960f-e131-4369-adf0-cf8dc9ef55ef tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb4dea95659c473b9b193c6234186430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1ca4b83dc874bda9f33e06f4910608c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:27:14.340207 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-8073960f-e131-4369-adf0-cf8dc9ef55ef tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] 10.222.0.46 "GET /compute/v2.1/servers/9333850c-071c-4330-98b9-84232a752ffe" status: 200 len: 1363 microversion: 2.1 time: 0.245380 Aug 04 05:27:14.340789 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 116/232] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:27:14 2022] GET /compute/v2.1/servers/9333850c-071c-4330-98b9-84232a752ffe => generated 1363 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:27:14.534942 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-18e34ab6-c90b-4092-823c-e5c115742f57 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8f887f5689419e9e31a0ba43f76ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62d19c831574f9b99c993b5e41c645d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:27:14.549058 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-18e34ab6-c90b-4092-823c-e5c115742f57 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] 10.222.0.46 "GET /compute/v2.1/servers/b1a612df-55d1-4106-951d-7f0ea95cfe83" status: 200 len: 1510 microversion: 2.1 time: 0.283764 Aug 04 05:27:14.549653 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 117/233] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:27:14 2022] GET /compute/v2.1/servers/b1a612df-55d1-4106-951d-7f0ea95cfe83 => generated 1510 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 05:27:14.745197 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-a41b840a-b60c-4374-8765-68a7fc641be6 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-979968500", "imageRef": "4613f7d0-37ca-46ad-bb26-dc4990dd7d6f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "87f9b625-400f-447c-aea1-da3d6773a311"}], "security_groups": [{"name": "tempest-securitygroup--1053223964"}], "key_name": "tempest-keypair-1764646286", "user_data": "}} {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:27:14.965137 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.network.neutron [None req-a41b840a-b60c-4374-8765-68a7fc641be6 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] validate_networks() for [('87f9b625-400f-447c-aea1-da3d6773a311', None, None, None, None, None)] {{(pid=118477) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 05:27:15.363671 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-480ad728-bcd5-4be7-b605-eaf6b9489328 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:27:15.364283 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-480ad728-bcd5-4be7-b605-eaf6b9489328 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] [instance: 9333850c-071c-4330-98b9-84232a752ffe] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:27:15.370920 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-480ad728-bcd5-4be7-b605-eaf6b9489328 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:27:15.371720 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-480ad728-bcd5-4be7-b605-eaf6b9489328 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:27:15.372846 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-480ad728-bcd5-4be7-b605-eaf6b9489328 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:27:15.373255 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-480ad728-bcd5-4be7-b605-eaf6b9489328 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:27:15.564372 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.virt.hardware [None req-a41b840a-b60c-4374-8765-68a7fc641be6 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Flavor limits 0:0:0 {{(pid=118477) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 05:27:15.564870 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.virt.hardware [None req-a41b840a-b60c-4374-8765-68a7fc641be6 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Image limits 0:0:0 {{(pid=118477) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 05:27:15.565583 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.virt.hardware [None req-a41b840a-b60c-4374-8765-68a7fc641be6 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Flavor pref 0:0:0 {{(pid=118477) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 05:27:15.566021 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.virt.hardware [None req-a41b840a-b60c-4374-8765-68a7fc641be6 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Image pref 0:0:0 {{(pid=118477) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 05:27:15.566548 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.virt.hardware [None req-a41b840a-b60c-4374-8765-68a7fc641be6 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118477) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 05:27:15.576367 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-a41b840a-b60c-4374-8765-68a7fc641be6 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:27:15.577165 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-a41b840a-b60c-4374-8765-68a7fc641be6 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:27:15.577973 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-a41b840a-b60c-4374-8765-68a7fc641be6 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:27:15.578595 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-a41b840a-b60c-4374-8765-68a7fc641be6 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:27:15.590109 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-480ad728-bcd5-4be7-b605-eaf6b9489328 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb4dea95659c473b9b193c6234186430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1ca4b83dc874bda9f33e06f4910608c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:27:15.596745 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.quota [None req-a41b840a-b60c-4374-8765-68a7fc641be6 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Getting quotas for project faead990837d43de8ec54bfaf24361de. Resources: {'instances', 'cores', 'ram'} {{(pid=118477) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 05:27:15.597626 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-480ad728-bcd5-4be7-b605-eaf6b9489328 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] 10.222.0.46 "GET /compute/v2.1/servers/9333850c-071c-4330-98b9-84232a752ffe" status: 200 len: 1363 microversion: 2.1 time: 0.237860 Aug 04 05:27:15.601668 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 118/234] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:27:15 2022] GET /compute/v2.1/servers/9333850c-071c-4330-98b9-84232a752ffe => generated 1363 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:27:15.601806 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.quota [None req-a41b840a-b60c-4374-8765-68a7fc641be6 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Getting quotas for user 9cb49b631c234f9a9fd47049b9b2e097 and project faead990837d43de8ec54bfaf24361de. Resources: {'instances', 'cores', 'ram'} {{(pid=118477) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 05:27:15.604522 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-c5a6aab7-4594-4d54-a559-1f705261e6a0 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:27:15.605157 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-c5a6aab7-4594-4d54-a559-1f705261e6a0 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] [instance: b1a612df-55d1-4106-951d-7f0ea95cfe83] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:27:15.611700 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-c5a6aab7-4594-4d54-a559-1f705261e6a0 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:27:15.612146 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-c5a6aab7-4594-4d54-a559-1f705261e6a0 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:27:15.612908 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-c5a6aab7-4594-4d54-a559-1f705261e6a0 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:27:15.613423 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-c5a6aab7-4594-4d54-a559-1f705261e6a0 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:27:15.613786 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-a41b840a-b60c-4374-8765-68a7fc641be6 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Going to run 1 instances... {{(pid=118477) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 05:27:15.616033 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-a41b840a-b60c-4374-8765-68a7fc641be6 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] [instance: b7dd37ec-81bf-4c77-90dc-eecb897d9d19] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4613f7d0-37ca-46ad-bb26-dc4990dd7d6f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118477) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 05:27:15.740321 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-a41b840a-b60c-4374-8765-68a7fc641be6 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.999889 Aug 04 05:27:15.740968 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 117/235] 10.222.0.46 () {60 vars in 1147 bytes} [Thu Aug 4 05:27:14 2022] POST /compute/v2.1/servers => generated 402 bytes in 1003 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 05:27:15.753218 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-6707fe4d-ee89-4145-885e-7648f71221f0 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:27:15.753818 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-6707fe4d-ee89-4145-885e-7648f71221f0 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] [instance: b7dd37ec-81bf-4c77-90dc-eecb897d9d19] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:27:15.800812 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-c5a6aab7-4594-4d54-a559-1f705261e6a0 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8f887f5689419e9e31a0ba43f76ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62d19c831574f9b99c993b5e41c645d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:27:15.809457 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-c5a6aab7-4594-4d54-a559-1f705261e6a0 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] 10.222.0.46 "GET /compute/v2.1/servers/b1a612df-55d1-4106-951d-7f0ea95cfe83" status: 200 len: 1510 microversion: 2.1 time: 0.210035 Aug 04 05:27:15.810381 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 119/236] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:27:15 2022] GET /compute/v2.1/servers/b1a612df-55d1-4106-951d-7f0ea95cfe83 => generated 1510 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:27:15.821100 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-6707fe4d-ee89-4145-885e-7648f71221f0 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb49b631c234f9a9fd47049b9b2e097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faead990837d43de8ec54bfaf24361de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:27:15.828669 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-6707fe4d-ee89-4145-885e-7648f71221f0 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] 10.222.0.46 "GET /compute/v2.1/servers/b7dd37ec-81bf-4c77-90dc-eecb897d9d19" status: 200 len: 1241 microversion: 2.1 time: 0.079496 Aug 04 05:27:15.829166 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 118/237] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:27:15 2022] GET /compute/v2.1/servers/b7dd37ec-81bf-4c77-90dc-eecb897d9d19 => generated 1241 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 05:27:16.044402 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-590c06fb-1a4d-43ab-8b1f-6b04488be477 tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1271153412", "imageRef": "4613f7d0-37ca-46ad-bb26-dc4990dd7d6f", "flavorRef": "452", "networks": [{"uuid": "96aaf21f-7035-4438-86f3-c8dd3a6d3230"}]}} {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:27:16.121727 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.network.neutron [None req-590c06fb-1a4d-43ab-8b1f-6b04488be477 tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] validate_networks() for [('96aaf21f-7035-4438-86f3-c8dd3a6d3230', None, None, None, None, None)] {{(pid=118476) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 05:27:16.498622 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.virt.hardware [None req-590c06fb-1a4d-43ab-8b1f-6b04488be477 tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] Flavor limits 0:0:0 {{(pid=118476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 05:27:16.499213 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.virt.hardware [None req-590c06fb-1a4d-43ab-8b1f-6b04488be477 tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] Image limits 0:0:0 {{(pid=118476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 05:27:16.499493 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.virt.hardware [None req-590c06fb-1a4d-43ab-8b1f-6b04488be477 tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] Flavor pref 0:0:0 {{(pid=118476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 05:27:16.499893 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.virt.hardware [None req-590c06fb-1a4d-43ab-8b1f-6b04488be477 tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] Image pref 0:0:0 {{(pid=118476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 05:27:16.500295 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.virt.hardware [None req-590c06fb-1a4d-43ab-8b1f-6b04488be477 tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 05:27:16.510620 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-590c06fb-1a4d-43ab-8b1f-6b04488be477 tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:27:16.511066 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-590c06fb-1a4d-43ab-8b1f-6b04488be477 tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:27:16.511878 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-590c06fb-1a4d-43ab-8b1f-6b04488be477 tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:27:16.512308 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-590c06fb-1a4d-43ab-8b1f-6b04488be477 tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:27:16.531775 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.quota [None req-590c06fb-1a4d-43ab-8b1f-6b04488be477 tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] Getting quotas for project ec163b07b5234a48ba80509ac693d8d3. Resources: {'instances', 'cores', 'ram'} {{(pid=118476) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 05:27:16.536830 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.quota [None req-590c06fb-1a4d-43ab-8b1f-6b04488be477 tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] Getting quotas for user 02d384cc766b4ef8bc0498f8fe3e5566 and project ec163b07b5234a48ba80509ac693d8d3. Resources: {'instances', 'cores', 'ram'} {{(pid=118476) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 05:27:16.551913 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-590c06fb-1a4d-43ab-8b1f-6b04488be477 tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] Going to run 1 instances... {{(pid=118476) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 05:27:16.555184 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-590c06fb-1a4d-43ab-8b1f-6b04488be477 tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] [instance: 48918fad-f7cb-4350-8ecf-e5f803fda4dd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4613f7d0-37ca-46ad-bb26-dc4990dd7d6f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118476) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 05:27:16.619211 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-82437443-40dc-4308-b265-c9ef6fc2bdb9 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:27:16.619768 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-82437443-40dc-4308-b265-c9ef6fc2bdb9 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] [instance: 9333850c-071c-4330-98b9-84232a752ffe] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:27:16.626593 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-82437443-40dc-4308-b265-c9ef6fc2bdb9 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:27:16.627145 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-82437443-40dc-4308-b265-c9ef6fc2bdb9 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:27:16.627805 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-82437443-40dc-4308-b265-c9ef6fc2bdb9 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:27:16.628240 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-82437443-40dc-4308-b265-c9ef6fc2bdb9 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:27:16.689241 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-590c06fb-1a4d-43ab-8b1f-6b04488be477 tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.649568 Aug 04 05:27:16.689915 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 120/238] 10.222.0.46 () {60 vars in 1147 bytes} [Thu Aug 4 05:27:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 651 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 05:27:16.701324 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-e3052eb9-1c94-44d0-82f7-8363659610f9 tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:27:16.701928 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-e3052eb9-1c94-44d0-82f7-8363659610f9 tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] [instance: 48918fad-f7cb-4350-8ecf-e5f803fda4dd] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:27:16.777642 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-e3052eb9-1c94-44d0-82f7-8363659610f9 tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d384cc766b4ef8bc0498f8fe3e5566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec163b07b5234a48ba80509ac693d8d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:27:16.787613 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-e3052eb9-1c94-44d0-82f7-8363659610f9 tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] 10.222.0.46 "GET /compute/v2.1/servers/48918fad-f7cb-4350-8ecf-e5f803fda4dd" status: 200 len: 1214 microversion: 2.1 time: 0.090686 Aug 04 05:27:16.788584 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 121/239] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:27:16 2022] GET /compute/v2.1/servers/48918fad-f7cb-4350-8ecf-e5f803fda4dd => generated 1214 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 05:27:16.810851 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-82437443-40dc-4308-b265-c9ef6fc2bdb9 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb4dea95659c473b9b193c6234186430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1ca4b83dc874bda9f33e06f4910608c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:27:16.819247 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-82437443-40dc-4308-b265-c9ef6fc2bdb9 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] 10.222.0.46 "GET /compute/v2.1/servers/9333850c-071c-4330-98b9-84232a752ffe" status: 200 len: 1548 microversion: 2.1 time: 0.203993 Aug 04 05:27:16.820006 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 119/240] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:27:16 2022] GET /compute/v2.1/servers/9333850c-071c-4330-98b9-84232a752ffe => generated 1548 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:27:16.833453 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-dd996fe2-680c-4b38-8990-33b2d523b562 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:27:16.834762 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-dd996fe2-680c-4b38-8990-33b2d523b562 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] [instance: b1a612df-55d1-4106-951d-7f0ea95cfe83] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:27:16.842665 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-d61ce50b-1acf-4aa1-a15d-0dfebab946ce tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:27:16.844911 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-d61ce50b-1acf-4aa1-a15d-0dfebab946ce tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] [instance: 9333850c-071c-4330-98b9-84232a752ffe] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:27:16.851405 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-d61ce50b-1acf-4aa1-a15d-0dfebab946ce tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:27:16.851916 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-dd996fe2-680c-4b38-8990-33b2d523b562 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:27:16.852093 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-d61ce50b-1acf-4aa1-a15d-0dfebab946ce tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:27:16.852625 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-dd996fe2-680c-4b38-8990-33b2d523b562 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:27:16.853255 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-d61ce50b-1acf-4aa1-a15d-0dfebab946ce tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:27:16.853578 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-dd996fe2-680c-4b38-8990-33b2d523b562 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:27:16.853907 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-dd996fe2-680c-4b38-8990-33b2d523b562 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:27:16.854208 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-d61ce50b-1acf-4aa1-a15d-0dfebab946ce tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:27:17.007647 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-d61ce50b-1acf-4aa1-a15d-0dfebab946ce tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] 10.222.0.46 "GET /compute/v2.1/servers/9333850c-071c-4330-98b9-84232a752ffe/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.168926 Aug 04 05:27:17.008515 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 120/241] 10.222.0.46 () {58 vars in 1275 bytes} [Thu Aug 4 05:27:16 2022] GET /compute/v2.1/servers/9333850c-071c-4330-98b9-84232a752ffe/os-interface => generated 284 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:27:17.014764 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-570b8adc-5845-48f7-a70e-6bc7e64e411b tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:27:17.015789 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-570b8adc-5845-48f7-a70e-6bc7e64e411b tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] [instance: b7dd37ec-81bf-4c77-90dc-eecb897d9d19] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:27:17.022481 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-570b8adc-5845-48f7-a70e-6bc7e64e411b tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:27:17.023140 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-570b8adc-5845-48f7-a70e-6bc7e64e411b tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:27:17.024136 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-570b8adc-5845-48f7-a70e-6bc7e64e411b tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:27:17.027123 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-570b8adc-5845-48f7-a70e-6bc7e64e411b tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:27:17.168370 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-570b8adc-5845-48f7-a70e-6bc7e64e411b tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb49b631c234f9a9fd47049b9b2e097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faead990837d43de8ec54bfaf24361de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:27:17.178296 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-570b8adc-5845-48f7-a70e-6bc7e64e411b tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] 10.222.0.46 "GET /compute/v2.1/servers/b7dd37ec-81bf-4c77-90dc-eecb897d9d19" status: 200 len: 1245 microversion: 2.1 time: 0.167835 Aug 04 05:27:17.178897 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 121/242] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:27:17 2022] GET /compute/v2.1/servers/b7dd37ec-81bf-4c77-90dc-eecb897d9d19 => generated 1245 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:27:17.246077 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-dd996fe2-680c-4b38-8990-33b2d523b562 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8f887f5689419e9e31a0ba43f76ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62d19c831574f9b99c993b5e41c645d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:27:17.258511 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-dd996fe2-680c-4b38-8990-33b2d523b562 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] 10.222.0.46 "GET /compute/v2.1/servers/b1a612df-55d1-4106-951d-7f0ea95cfe83" status: 200 len: 1510 microversion: 2.1 time: 0.429650 Aug 04 05:27:17.270716 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 122/243] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:27:16 2022] GET /compute/v2.1/servers/b1a612df-55d1-4106-951d-7f0ea95cfe83 => generated 1510 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:27:17.813615 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-f036951f-878e-4892-801e-4b1959641438 tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:27:17.814218 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-f036951f-878e-4892-801e-4b1959641438 tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] [instance: 48918fad-f7cb-4350-8ecf-e5f803fda4dd] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:27:17.885350 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-f036951f-878e-4892-801e-4b1959641438 tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d384cc766b4ef8bc0498f8fe3e5566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec163b07b5234a48ba80509ac693d8d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:27:17.894928 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-f036951f-878e-4892-801e-4b1959641438 tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] 10.222.0.46 "GET /compute/v2.1/servers/48918fad-f7cb-4350-8ecf-e5f803fda4dd" status: 200 len: 1214 microversion: 2.1 time: 0.084769 Aug 04 05:27:17.895641 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 122/244] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:27:17 2022] GET /compute/v2.1/servers/48918fad-f7cb-4350-8ecf-e5f803fda4dd => generated 1214 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 05:27:18.213566 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-e6164b1e-098e-4b83-9efe-587ee545123e tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:27:18.214745 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-e6164b1e-098e-4b83-9efe-587ee545123e tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] [instance: b7dd37ec-81bf-4c77-90dc-eecb897d9d19] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:27:18.226214 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-e6164b1e-098e-4b83-9efe-587ee545123e tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:27:18.227576 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-e6164b1e-098e-4b83-9efe-587ee545123e tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:27:18.229100 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-e6164b1e-098e-4b83-9efe-587ee545123e tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:27:18.229784 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-e6164b1e-098e-4b83-9efe-587ee545123e tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:27:18.285927 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-d12bdbdc-9c26-488b-8d42-bff2e09a43d5 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:27:18.287632 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-d12bdbdc-9c26-488b-8d42-bff2e09a43d5 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] [instance: b1a612df-55d1-4106-951d-7f0ea95cfe83] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:27:18.294782 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-d12bdbdc-9c26-488b-8d42-bff2e09a43d5 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:27:18.295225 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-d12bdbdc-9c26-488b-8d42-bff2e09a43d5 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:27:18.295990 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-d12bdbdc-9c26-488b-8d42-bff2e09a43d5 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:27:18.296417 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-d12bdbdc-9c26-488b-8d42-bff2e09a43d5 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:27:18.297623 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-e6164b1e-098e-4b83-9efe-587ee545123e tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb49b631c234f9a9fd47049b9b2e097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faead990837d43de8ec54bfaf24361de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:27:18.306869 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-e6164b1e-098e-4b83-9efe-587ee545123e tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] 10.222.0.46 "GET /compute/v2.1/servers/b7dd37ec-81bf-4c77-90dc-eecb897d9d19" status: 200 len: 1237 microversion: 2.1 time: 0.099542 Aug 04 05:27:18.312105 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 123/245] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:27:18 2022] GET /compute/v2.1/servers/b7dd37ec-81bf-4c77-90dc-eecb897d9d19 => generated 1237 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:27:18.476455 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [req-cc16a529-d806-466f-9f2f-22ea8246a495 req-fcf292f4-9134-420d-9515-814324021405 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9333850c-071c-4330-98b9-84232a752ffe", "tag": "4660aa79-5e1b-4fcd-8608-50d5264cea3e"}]} {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:27:18.487824 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [req-cc16a529-d806-466f-9f2f-22ea8246a495 req-fcf292f4-9134-420d-9515-814324021405 service nova] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:27:18.488779 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [req-cc16a529-d806-466f-9f2f-22ea8246a495 req-fcf292f4-9134-420d-9515-814324021405 service nova] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:27:18.488934 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-d12bdbdc-9c26-488b-8d42-bff2e09a43d5 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8f887f5689419e9e31a0ba43f76ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62d19c831574f9b99c993b5e41c645d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:27:18.510897 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-d12bdbdc-9c26-488b-8d42-bff2e09a43d5 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] 10.222.0.46 "GET /compute/v2.1/servers/b1a612df-55d1-4106-951d-7f0ea95cfe83" status: 200 len: 1516 microversion: 2.1 time: 0.229299 Aug 04 05:27:18.514785 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 123/246] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:27:18 2022] GET /compute/v2.1/servers/b1a612df-55d1-4106-951d-7f0ea95cfe83 => generated 1516 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 05:27:18.518261 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.compute.server_external_events [req-cc16a529-d806-466f-9f2f-22ea8246a495 req-fcf292f4-9134-420d-9515-814324021405 service nova] Creating event network-changed:4660aa79-5e1b-4fcd-8608-50d5264cea3e for instance 9333850c-071c-4330-98b9-84232a752ffe on hv-cinder-85207 Aug 04 05:27:18.533405 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [req-cc16a529-d806-466f-9f2f-22ea8246a495 req-fcf292f4-9134-420d-9515-814324021405 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061299 Aug 04 05:27:18.538792 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 124/247] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Aug 4 05:27:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 05:27:18.922465 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-0a2a95f6-78a3-4bcc-a919-8c219626baf6 tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:27:18.923441 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-0a2a95f6-78a3-4bcc-a919-8c219626baf6 tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] [instance: 48918fad-f7cb-4350-8ecf-e5f803fda4dd] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:27:18.930417 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-0a2a95f6-78a3-4bcc-a919-8c219626baf6 tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:27:18.932170 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-0a2a95f6-78a3-4bcc-a919-8c219626baf6 tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:27:18.934529 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-0a2a95f6-78a3-4bcc-a919-8c219626baf6 tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:27:18.934529 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-0a2a95f6-78a3-4bcc-a919-8c219626baf6 tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:27:19.025647 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-0a2a95f6-78a3-4bcc-a919-8c219626baf6 tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d384cc766b4ef8bc0498f8fe3e5566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec163b07b5234a48ba80509ac693d8d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:27:19.046346 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-0a2a95f6-78a3-4bcc-a919-8c219626baf6 tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] 10.222.0.46 "GET /compute/v2.1/servers/48918fad-f7cb-4350-8ecf-e5f803fda4dd" status: 200 len: 1210 microversion: 2.1 time: 0.128382 Aug 04 05:27:19.051741 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 124/248] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:27:18 2022] GET /compute/v2.1/servers/48918fad-f7cb-4350-8ecf-e5f803fda4dd => generated 1210 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:27:19.330132 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-dd984f9a-f7f1-4509-8374-67a5a652782f tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:27:19.331171 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-dd984f9a-f7f1-4509-8374-67a5a652782f tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] [instance: b7dd37ec-81bf-4c77-90dc-eecb897d9d19] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:27:19.341660 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-dd984f9a-f7f1-4509-8374-67a5a652782f tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:27:19.342100 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-dd984f9a-f7f1-4509-8374-67a5a652782f tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:27:19.342886 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-dd984f9a-f7f1-4509-8374-67a5a652782f tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:27:19.343313 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-dd984f9a-f7f1-4509-8374-67a5a652782f tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:27:19.423497 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-dd984f9a-f7f1-4509-8374-67a5a652782f tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb49b631c234f9a9fd47049b9b2e097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faead990837d43de8ec54bfaf24361de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:27:19.442291 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-dd984f9a-f7f1-4509-8374-67a5a652782f tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] 10.222.0.46 "GET /compute/v2.1/servers/b7dd37ec-81bf-4c77-90dc-eecb897d9d19" status: 200 len: 1301 microversion: 2.1 time: 0.113079 Aug 04 05:27:19.442996 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 125/249] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:27:19 2022] GET /compute/v2.1/servers/b7dd37ec-81bf-4c77-90dc-eecb897d9d19 => generated 1301 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:27:20.078764 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-1d70557e-5333-4780-909d-c8ac8eac0f2e tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:27:20.079363 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-1d70557e-5333-4780-909d-c8ac8eac0f2e tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] [instance: 48918fad-f7cb-4350-8ecf-e5f803fda4dd] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:27:20.089191 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-1d70557e-5333-4780-909d-c8ac8eac0f2e tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:27:20.089640 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-1d70557e-5333-4780-909d-c8ac8eac0f2e tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:27:20.090469 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-1d70557e-5333-4780-909d-c8ac8eac0f2e tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:27:20.090910 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-1d70557e-5333-4780-909d-c8ac8eac0f2e tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:27:20.192306 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-1d70557e-5333-4780-909d-c8ac8eac0f2e tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d384cc766b4ef8bc0498f8fe3e5566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec163b07b5234a48ba80509ac693d8d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:27:20.199992 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-1d70557e-5333-4780-909d-c8ac8eac0f2e tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] 10.222.0.46 "GET /compute/v2.1/servers/48918fad-f7cb-4350-8ecf-e5f803fda4dd" status: 200 len: 1266 microversion: 2.1 time: 0.125202 Aug 04 05:27:20.200566 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 125/250] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:27:20 2022] GET /compute/v2.1/servers/48918fad-f7cb-4350-8ecf-e5f803fda4dd => generated 1266 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:27:20.486777 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-3dbb08d5-7a7c-4fa8-92de-5e24537baa87 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:27:20.489233 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-3dbb08d5-7a7c-4fa8-92de-5e24537baa87 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] [instance: b7dd37ec-81bf-4c77-90dc-eecb897d9d19] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:27:20.498863 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-3dbb08d5-7a7c-4fa8-92de-5e24537baa87 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:27:20.499903 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-3dbb08d5-7a7c-4fa8-92de-5e24537baa87 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:27:20.501086 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-3dbb08d5-7a7c-4fa8-92de-5e24537baa87 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:27:20.501764 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-3dbb08d5-7a7c-4fa8-92de-5e24537baa87 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:27:20.620976 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-3dbb08d5-7a7c-4fa8-92de-5e24537baa87 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb49b631c234f9a9fd47049b9b2e097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faead990837d43de8ec54bfaf24361de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:27:20.632624 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-3dbb08d5-7a7c-4fa8-92de-5e24537baa87 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] 10.222.0.46 "GET /compute/v2.1/servers/b7dd37ec-81bf-4c77-90dc-eecb897d9d19" status: 200 len: 1299 microversion: 2.1 time: 0.168544 Aug 04 05:27:20.634434 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 126/251] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:27:20 2022] GET /compute/v2.1/servers/b7dd37ec-81bf-4c77-90dc-eecb897d9d19 => generated 1299 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:27:20.721667 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-d1665d05-1cd8-4f5b-84c5-0ad6c8cacb89 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Action: 'create', calling method: .version_select at 0x7f1475715af0>, body: {"keypair": {"name": "tempest-keypair-1750445904", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCuykqxv+6wYM4+vq5X7Zdj5Q2D/gkjBXdZ8ei5Ky2ogvAFrYiGGSKyEIvRXp5GsfK3v0FBc8t0R2W5YvIgXbha45gS7qCtIkB78vkXlzpWkZKop1/NjRwl0Sp8xYw3Y9A=="}} {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:27:20.743980 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.quota [None req-d1665d05-1cd8-4f5b-84c5-0ad6c8cacb89 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Getting quotas for project b62d19c831574f9b99c993b5e41c645d. Resources: {'key_pairs'} {{(pid=118477) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 05:27:20.748551 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.quota [None req-d1665d05-1cd8-4f5b-84c5-0ad6c8cacb89 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Getting quotas for user ab8f887f5689419e9e31a0ba43f76ada and project b62d19c831574f9b99c993b5e41c645d. Resources: {'key_pairs'} {{(pid=118477) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 05:27:20.854861 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-d1665d05-1cd8-4f5b-84c5-0ad6c8cacb89 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.138796 Aug 04 05:27:20.858060 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 126/252] 10.222.0.46 () {60 vars in 1159 bytes} [Thu Aug 4 05:27:20 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 05:27:21.221245 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-c032e6ea-001a-41ef-91d4-ca37402a5d7a tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:27:21.221862 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-c032e6ea-001a-41ef-91d4-ca37402a5d7a tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] [instance: 48918fad-f7cb-4350-8ecf-e5f803fda4dd] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:27:21.223889 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG dbcounter [-] [118476] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=4 {{(pid=118476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:27:21.229986 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-c032e6ea-001a-41ef-91d4-ca37402a5d7a tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:27:21.230601 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-c032e6ea-001a-41ef-91d4-ca37402a5d7a tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:27:21.231433 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-c032e6ea-001a-41ef-91d4-ca37402a5d7a tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:27:21.232178 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-c032e6ea-001a-41ef-91d4-ca37402a5d7a tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:27:21.319742 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-c032e6ea-001a-41ef-91d4-ca37402a5d7a tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d384cc766b4ef8bc0498f8fe3e5566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec163b07b5234a48ba80509ac693d8d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:27:21.327964 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG dbcounter [-] [118476] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:27:21.336083 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-c032e6ea-001a-41ef-91d4-ca37402a5d7a tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] 10.222.0.46 "GET /compute/v2.1/servers/48918fad-f7cb-4350-8ecf-e5f803fda4dd" status: 200 len: 1272 microversion: 2.1 time: 0.118696 Aug 04 05:27:21.338145 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 127/253] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:27:21 2022] GET /compute/v2.1/servers/48918fad-f7cb-4350-8ecf-e5f803fda4dd => generated 1272 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:27:21.679901 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-26b11c79-8999-4f74-b479-c282de239a18 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:27:21.684016 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-26b11c79-8999-4f74-b479-c282de239a18 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] [instance: b7dd37ec-81bf-4c77-90dc-eecb897d9d19] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:27:21.720574 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-26b11c79-8999-4f74-b479-c282de239a18 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:27:21.722026 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-26b11c79-8999-4f74-b479-c282de239a18 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:27:21.724057 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-26b11c79-8999-4f74-b479-c282de239a18 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:27:21.724880 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-26b11c79-8999-4f74-b479-c282de239a18 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:27:22.008032 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-26b11c79-8999-4f74-b479-c282de239a18 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb49b631c234f9a9fd47049b9b2e097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faead990837d43de8ec54bfaf24361de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:27:22.010605 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG dbcounter [-] [118477] Writing DB stats nova_cell1:SELECT=100 {{(pid=118477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:27:22.016623 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-26b11c79-8999-4f74-b479-c282de239a18 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] 10.222.0.46 "GET /compute/v2.1/servers/b7dd37ec-81bf-4c77-90dc-eecb897d9d19" status: 200 len: 1367 microversion: 2.1 time: 0.358048 Aug 04 05:27:22.017209 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 127/254] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:27:21 2022] GET /compute/v2.1/servers/b7dd37ec-81bf-4c77-90dc-eecb897d9d19 => generated 1367 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:27:22.361707 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-f7d67b86-84f2-4194-912d-f9eb8620fbbf tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:27:22.362459 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-f7d67b86-84f2-4194-912d-f9eb8620fbbf tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] [instance: 48918fad-f7cb-4350-8ecf-e5f803fda4dd] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:27:22.371482 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-f7d67b86-84f2-4194-912d-f9eb8620fbbf tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:27:22.372425 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-f7d67b86-84f2-4194-912d-f9eb8620fbbf tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:27:22.373355 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-f7d67b86-84f2-4194-912d-f9eb8620fbbf tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:27:22.374033 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-f7d67b86-84f2-4194-912d-f9eb8620fbbf tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:27:22.800699 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-f7d67b86-84f2-4194-912d-f9eb8620fbbf tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d384cc766b4ef8bc0498f8fe3e5566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec163b07b5234a48ba80509ac693d8d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:27:22.809924 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-f7d67b86-84f2-4194-912d-f9eb8620fbbf tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] 10.222.0.46 "GET /compute/v2.1/servers/48918fad-f7cb-4350-8ecf-e5f803fda4dd" status: 200 len: 1314 microversion: 2.1 time: 0.452492 Aug 04 05:27:22.810875 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 128/255] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:27:22 2022] GET /compute/v2.1/servers/48918fad-f7cb-4350-8ecf-e5f803fda4dd => generated 1314 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:27:22.852457 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [req-c4855197-d819-4572-980f-35095c5bebf0 req-fd89f44e-143f-4852-ba7d-05c784522000 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b7dd37ec-81bf-4c77-90dc-eecb897d9d19", "tag": "6eecea9c-0ed5-43c6-ad5e-85403bfef11c"}]} {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:27:22.871282 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [req-c4855197-d819-4572-980f-35095c5bebf0 req-fd89f44e-143f-4852-ba7d-05c784522000 service nova] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:27:22.871819 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [req-c4855197-d819-4572-980f-35095c5bebf0 req-fd89f44e-143f-4852-ba7d-05c784522000 service nova] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:27:22.887413 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.compute.server_external_events [req-c4855197-d819-4572-980f-35095c5bebf0 req-fd89f44e-143f-4852-ba7d-05c784522000 service nova] Creating event network-changed:6eecea9c-0ed5-43c6-ad5e-85403bfef11c for instance b7dd37ec-81bf-4c77-90dc-eecb897d9d19 on hv-cinder-85207 Aug 04 05:27:22.892970 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [req-c4855197-d819-4572-980f-35095c5bebf0 req-fd89f44e-143f-4852-ba7d-05c784522000 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046658 Aug 04 05:27:22.893756 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 128/256] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Aug 4 05:27:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:27:22.996915 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [req-2092c315-1074-4d98-8890-d54ca7255fd8 req-a8de09ba-9760-4c67-9fbb-5c18d06c49e5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "48918fad-f7cb-4350-8ecf-e5f803fda4dd", "tag": "67598c9d-5f55-4d52-a8ef-68e91a202a41"}]} {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:27:23.009775 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [req-2092c315-1074-4d98-8890-d54ca7255fd8 req-a8de09ba-9760-4c67-9fbb-5c18d06c49e5 service nova] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:27:23.010331 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [req-2092c315-1074-4d98-8890-d54ca7255fd8 req-a8de09ba-9760-4c67-9fbb-5c18d06c49e5 service nova] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:27:23.022389 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.compute.server_external_events [req-2092c315-1074-4d98-8890-d54ca7255fd8 req-a8de09ba-9760-4c67-9fbb-5c18d06c49e5 service nova] Creating event network-changed:67598c9d-5f55-4d52-a8ef-68e91a202a41 for instance 48918fad-f7cb-4350-8ecf-e5f803fda4dd on hv-cinder-85207 Aug 04 05:27:23.031694 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [req-2092c315-1074-4d98-8890-d54ca7255fd8 req-a8de09ba-9760-4c67-9fbb-5c18d06c49e5 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038890 Aug 04 05:27:23.033081 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 129/257] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Aug 4 05:27:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:27:23.038129 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-e25b64f9-01bc-4f95-9af5-565114759e97 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:27:23.038869 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-e25b64f9-01bc-4f95-9af5-565114759e97 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] [instance: b7dd37ec-81bf-4c77-90dc-eecb897d9d19] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:27:23.050126 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-e25b64f9-01bc-4f95-9af5-565114759e97 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:27:23.050856 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-e25b64f9-01bc-4f95-9af5-565114759e97 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:27:23.051884 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-e25b64f9-01bc-4f95-9af5-565114759e97 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:27:23.052550 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-e25b64f9-01bc-4f95-9af5-565114759e97 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:27:23.447800 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-e25b64f9-01bc-4f95-9af5-565114759e97 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb49b631c234f9a9fd47049b9b2e097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faead990837d43de8ec54bfaf24361de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:27:23.456820 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-e25b64f9-01bc-4f95-9af5-565114759e97 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] 10.222.0.46 "GET /compute/v2.1/servers/b7dd37ec-81bf-4c77-90dc-eecb897d9d19" status: 200 len: 1367 microversion: 2.1 time: 0.423263 Aug 04 05:27:23.473428 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 129/258] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:27:23 2022] GET /compute/v2.1/servers/b7dd37ec-81bf-4c77-90dc-eecb897d9d19 => generated 1367 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 05:27:23.850223 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-0d99cd8c-66af-429b-987c-bacb6a42a303 tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:27:23.852953 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-0d99cd8c-66af-429b-987c-bacb6a42a303 tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] [instance: 48918fad-f7cb-4350-8ecf-e5f803fda4dd] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:27:23.875262 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-0d99cd8c-66af-429b-987c-bacb6a42a303 tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:27:23.876016 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-0d99cd8c-66af-429b-987c-bacb6a42a303 tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:27:23.876964 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-0d99cd8c-66af-429b-987c-bacb6a42a303 tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:27:23.880295 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-0d99cd8c-66af-429b-987c-bacb6a42a303 tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:27:24.183598 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-0d99cd8c-66af-429b-987c-bacb6a42a303 tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d384cc766b4ef8bc0498f8fe3e5566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec163b07b5234a48ba80509ac693d8d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:27:24.192168 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-0d99cd8c-66af-429b-987c-bacb6a42a303 tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] 10.222.0.46 "GET /compute/v2.1/servers/48918fad-f7cb-4350-8ecf-e5f803fda4dd" status: 200 len: 1314 microversion: 2.1 time: 0.362001 Aug 04 05:27:24.192761 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 130/259] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:27:23 2022] GET /compute/v2.1/servers/48918fad-f7cb-4350-8ecf-e5f803fda4dd => generated 1314 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:27:24.481256 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-15aa3157-171a-4a09-aa9c-0a183dfe0d93 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:27:24.481871 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-15aa3157-171a-4a09-aa9c-0a183dfe0d93 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] [instance: b7dd37ec-81bf-4c77-90dc-eecb897d9d19] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:27:24.488855 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-15aa3157-171a-4a09-aa9c-0a183dfe0d93 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:27:24.489549 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-15aa3157-171a-4a09-aa9c-0a183dfe0d93 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:27:24.490601 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-15aa3157-171a-4a09-aa9c-0a183dfe0d93 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:27:24.491231 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-15aa3157-171a-4a09-aa9c-0a183dfe0d93 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:27:24.879807 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-15aa3157-171a-4a09-aa9c-0a183dfe0d93 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb49b631c234f9a9fd47049b9b2e097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faead990837d43de8ec54bfaf24361de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:27:24.887989 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-15aa3157-171a-4a09-aa9c-0a183dfe0d93 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] 10.222.0.46 "GET /compute/v2.1/servers/b7dd37ec-81bf-4c77-90dc-eecb897d9d19" status: 200 len: 1367 microversion: 2.1 time: 0.410624 Aug 04 05:27:24.888947 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 130/260] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:27:24 2022] GET /compute/v2.1/servers/b7dd37ec-81bf-4c77-90dc-eecb897d9d19 => generated 1367 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:27:25.215334 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-c4704bd8-30f9-4600-ac01-e27f9350522c tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:27:25.215938 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-c4704bd8-30f9-4600-ac01-e27f9350522c tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] [instance: 48918fad-f7cb-4350-8ecf-e5f803fda4dd] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:27:25.222601 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-c4704bd8-30f9-4600-ac01-e27f9350522c tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:27:25.223024 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-c4704bd8-30f9-4600-ac01-e27f9350522c tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:27:25.223780 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-c4704bd8-30f9-4600-ac01-e27f9350522c tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:27:25.224207 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-c4704bd8-30f9-4600-ac01-e27f9350522c tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:27:25.437846 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-c4704bd8-30f9-4600-ac01-e27f9350522c tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d384cc766b4ef8bc0498f8fe3e5566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec163b07b5234a48ba80509ac693d8d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:27:25.446077 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-c4704bd8-30f9-4600-ac01-e27f9350522c tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] 10.222.0.46 "GET /compute/v2.1/servers/48918fad-f7cb-4350-8ecf-e5f803fda4dd" status: 200 len: 1314 microversion: 2.1 time: 0.235226 Aug 04 05:27:25.446692 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 131/261] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:27:25 2022] GET /compute/v2.1/servers/48918fad-f7cb-4350-8ecf-e5f803fda4dd => generated 1314 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:27:25.508846 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-dc7c4cc6-d430-43f6-acb7-47dcd22648f5 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-631822281", "imageRef": "4613f7d0-37ca-46ad-bb26-dc4990dd7d6f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3d15e8aa-2034-4916-a765-53a0b213f5c6"}], "security_groups": [{"name": "tempest-securitygroup--1257882190"}], "key_name": "tempest-keypair-1750445904", "user_data": "}} {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:27:25.587778 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG dbcounter [-] [118477] Writing DB stats nova_cell0:SELECT=2 {{(pid=118477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:27:25.630427 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.network.neutron [None req-dc7c4cc6-d430-43f6-acb7-47dcd22648f5 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] validate_networks() for [('3d15e8aa-2034-4916-a765-53a0b213f5c6', None, None, None, None, None)] {{(pid=118477) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 05:27:25.909259 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-ed40d1ed-4b33-4b00-933b-64d64c1e14e5 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:27:25.910158 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-ed40d1ed-4b33-4b00-933b-64d64c1e14e5 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] [instance: b7dd37ec-81bf-4c77-90dc-eecb897d9d19] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:27:25.919500 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-ed40d1ed-4b33-4b00-933b-64d64c1e14e5 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:27:25.920280 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-ed40d1ed-4b33-4b00-933b-64d64c1e14e5 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:27:25.921329 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-ed40d1ed-4b33-4b00-933b-64d64c1e14e5 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:27:25.922041 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-ed40d1ed-4b33-4b00-933b-64d64c1e14e5 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:27:26.376378 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-ed40d1ed-4b33-4b00-933b-64d64c1e14e5 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb49b631c234f9a9fd47049b9b2e097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faead990837d43de8ec54bfaf24361de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:27:26.387144 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-ed40d1ed-4b33-4b00-933b-64d64c1e14e5 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] 10.222.0.46 "GET /compute/v2.1/servers/b7dd37ec-81bf-4c77-90dc-eecb897d9d19" status: 200 len: 1367 microversion: 2.1 time: 0.481151 Aug 04 05:27:26.400742 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 132/262] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:27:25 2022] GET /compute/v2.1/servers/b7dd37ec-81bf-4c77-90dc-eecb897d9d19 => generated 1367 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 05:27:26.425968 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.virt.hardware [None req-dc7c4cc6-d430-43f6-acb7-47dcd22648f5 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Flavor limits 0:0:0 {{(pid=118477) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 05:27:26.426421 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.virt.hardware [None req-dc7c4cc6-d430-43f6-acb7-47dcd22648f5 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Image limits 0:0:0 {{(pid=118477) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 05:27:26.426898 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.virt.hardware [None req-dc7c4cc6-d430-43f6-acb7-47dcd22648f5 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Flavor pref 0:0:0 {{(pid=118477) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 05:27:26.427355 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.virt.hardware [None req-dc7c4cc6-d430-43f6-acb7-47dcd22648f5 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Image pref 0:0:0 {{(pid=118477) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 05:27:26.427771 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.virt.hardware [None req-dc7c4cc6-d430-43f6-acb7-47dcd22648f5 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118477) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 05:27:26.437997 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-dc7c4cc6-d430-43f6-acb7-47dcd22648f5 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:27:26.438503 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-dc7c4cc6-d430-43f6-acb7-47dcd22648f5 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:27:26.439324 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-dc7c4cc6-d430-43f6-acb7-47dcd22648f5 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:27:26.439759 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-dc7c4cc6-d430-43f6-acb7-47dcd22648f5 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:27:26.457712 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.quota [None req-dc7c4cc6-d430-43f6-acb7-47dcd22648f5 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Getting quotas for project b62d19c831574f9b99c993b5e41c645d. Resources: {'instances', 'cores', 'ram'} {{(pid=118477) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 05:27:26.467262 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.quota [None req-dc7c4cc6-d430-43f6-acb7-47dcd22648f5 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Getting quotas for user ab8f887f5689419e9e31a0ba43f76ada and project b62d19c831574f9b99c993b5e41c645d. Resources: {'instances', 'cores', 'ram'} {{(pid=118477) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 05:27:26.471274 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-797e06ac-502f-451a-a454-f53e1c709300 tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:27:26.472045 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-797e06ac-502f-451a-a454-f53e1c709300 tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] [instance: 48918fad-f7cb-4350-8ecf-e5f803fda4dd] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:27:26.481230 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-797e06ac-502f-451a-a454-f53e1c709300 tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:27:26.482011 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-797e06ac-502f-451a-a454-f53e1c709300 tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:27:26.482892 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-797e06ac-502f-451a-a454-f53e1c709300 tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:27:26.483724 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-797e06ac-502f-451a-a454-f53e1c709300 tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:27:26.491742 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-dc7c4cc6-d430-43f6-acb7-47dcd22648f5 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Going to run 1 instances... {{(pid=118477) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 05:27:26.499709 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-dc7c4cc6-d430-43f6-acb7-47dcd22648f5 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] [instance: 178b675e-f4d0-442c-aa69-aece6ea3d636] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4613f7d0-37ca-46ad-bb26-dc4990dd7d6f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118477) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 05:27:26.520340 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG dbcounter [-] [118476] Writing DB stats nova_cell0:SELECT=2 {{(pid=118476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:27:26.657585 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-797e06ac-502f-451a-a454-f53e1c709300 tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d384cc766b4ef8bc0498f8fe3e5566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec163b07b5234a48ba80509ac693d8d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:27:26.666061 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-797e06ac-502f-451a-a454-f53e1c709300 tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] 10.222.0.46 "GET /compute/v2.1/servers/48918fad-f7cb-4350-8ecf-e5f803fda4dd" status: 200 len: 1314 microversion: 2.1 time: 0.200031 Aug 04 05:27:26.666678 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 133/263] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:27:26 2022] GET /compute/v2.1/servers/48918fad-f7cb-4350-8ecf-e5f803fda4dd => generated 1314 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 05:27:26.722355 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-dc7c4cc6-d430-43f6-acb7-47dcd22648f5 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 1.217372 Aug 04 05:27:26.724295 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 131/264] 10.222.0.46 () {60 vars in 1147 bytes} [Thu Aug 4 05:27:25 2022] POST /compute/v2.1/servers => generated 409 bytes in 1220 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 05:27:26.741860 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-6d78f5b2-dd42-4c6f-948e-5d8cd86d5204 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:27:26.742546 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-6d78f5b2-dd42-4c6f-948e-5d8cd86d5204 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] [instance: 178b675e-f4d0-442c-aa69-aece6ea3d636] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:27:26.787351 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG dbcounter [-] [118476] Writing DB stats nova_cell0:SELECT=16 {{(pid=118476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:27:26.809107 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-6d78f5b2-dd42-4c6f-948e-5d8cd86d5204 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8f887f5689419e9e31a0ba43f76ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62d19c831574f9b99c993b5e41c645d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:27:26.815558 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-6d78f5b2-dd42-4c6f-948e-5d8cd86d5204 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] 10.222.0.46 "GET /compute/v2.1/servers/178b675e-f4d0-442c-aa69-aece6ea3d636" status: 200 len: 1245 microversion: 2.1 time: 0.083072 Aug 04 05:27:26.816184 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 134/265] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:27:26 2022] GET /compute/v2.1/servers/178b675e-f4d0-442c-aa69-aece6ea3d636 => generated 1245 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:27:27.410358 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-eb8cedd8-c462-4928-881f-313e17d9da69 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:27:27.411198 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-eb8cedd8-c462-4928-881f-313e17d9da69 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] [instance: b7dd37ec-81bf-4c77-90dc-eecb897d9d19] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:27:27.418955 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG dbcounter [-] [118477] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=8 {{(pid=118477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:27:27.420818 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-eb8cedd8-c462-4928-881f-313e17d9da69 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:27:27.421425 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-eb8cedd8-c462-4928-881f-313e17d9da69 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:27:27.422421 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-eb8cedd8-c462-4928-881f-313e17d9da69 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:27:27.422860 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-eb8cedd8-c462-4928-881f-313e17d9da69 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:27:27.565468 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-eb8cedd8-c462-4928-881f-313e17d9da69 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb49b631c234f9a9fd47049b9b2e097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faead990837d43de8ec54bfaf24361de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:27:27.573548 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-eb8cedd8-c462-4928-881f-313e17d9da69 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] 10.222.0.46 "GET /compute/v2.1/servers/b7dd37ec-81bf-4c77-90dc-eecb897d9d19" status: 200 len: 1367 microversion: 2.1 time: 0.168114 Aug 04 05:27:27.574136 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 132/266] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:27:27 2022] GET /compute/v2.1/servers/b7dd37ec-81bf-4c77-90dc-eecb897d9d19 => generated 1367 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:27:27.688019 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-e4d157bc-4838-4af9-8247-fc660394802c tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:27:27.688667 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-e4d157bc-4838-4af9-8247-fc660394802c tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] [instance: 48918fad-f7cb-4350-8ecf-e5f803fda4dd] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:27:27.697164 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-e4d157bc-4838-4af9-8247-fc660394802c tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:27:27.697726 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-e4d157bc-4838-4af9-8247-fc660394802c tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:27:27.698782 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-e4d157bc-4838-4af9-8247-fc660394802c tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:27:27.699269 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-e4d157bc-4838-4af9-8247-fc660394802c tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:27:27.840682 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-522089da-c3ba-49cf-91f0-713af4826d1f tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:27:27.842182 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-522089da-c3ba-49cf-91f0-713af4826d1f tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] [instance: 178b675e-f4d0-442c-aa69-aece6ea3d636] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:27:27.847017 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-e4d157bc-4838-4af9-8247-fc660394802c tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d384cc766b4ef8bc0498f8fe3e5566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec163b07b5234a48ba80509ac693d8d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:27:27.849058 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-522089da-c3ba-49cf-91f0-713af4826d1f tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:27:27.849728 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-522089da-c3ba-49cf-91f0-713af4826d1f tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:27:27.850611 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-522089da-c3ba-49cf-91f0-713af4826d1f tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:27:27.851056 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-522089da-c3ba-49cf-91f0-713af4826d1f tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:27:27.856692 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-e4d157bc-4838-4af9-8247-fc660394802c tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] 10.222.0.46 "GET /compute/v2.1/servers/48918fad-f7cb-4350-8ecf-e5f803fda4dd" status: 200 len: 1314 microversion: 2.1 time: 0.172418 Aug 04 05:27:27.857292 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 135/267] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:27:27 2022] GET /compute/v2.1/servers/48918fad-f7cb-4350-8ecf-e5f803fda4dd => generated 1314 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:27:27.925776 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-522089da-c3ba-49cf-91f0-713af4826d1f tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8f887f5689419e9e31a0ba43f76ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62d19c831574f9b99c993b5e41c645d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:27:27.933907 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-522089da-c3ba-49cf-91f0-713af4826d1f tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] 10.222.0.46 "GET /compute/v2.1/servers/178b675e-f4d0-442c-aa69-aece6ea3d636" status: 200 len: 1249 microversion: 2.1 time: 0.098743 Aug 04 05:27:27.934511 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 133/268] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:27:27 2022] GET /compute/v2.1/servers/178b675e-f4d0-442c-aa69-aece6ea3d636 => generated 1249 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:27:28.593894 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-2c834f2d-5a9c-4ff3-8838-db95249ae982 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:27:28.594616 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-2c834f2d-5a9c-4ff3-8838-db95249ae982 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] [instance: b7dd37ec-81bf-4c77-90dc-eecb897d9d19] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:27:28.601466 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-2c834f2d-5a9c-4ff3-8838-db95249ae982 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:27:28.602157 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-2c834f2d-5a9c-4ff3-8838-db95249ae982 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:27:28.603512 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-2c834f2d-5a9c-4ff3-8838-db95249ae982 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:27:28.604068 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-2c834f2d-5a9c-4ff3-8838-db95249ae982 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:27:28.748773 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-2c834f2d-5a9c-4ff3-8838-db95249ae982 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb49b631c234f9a9fd47049b9b2e097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faead990837d43de8ec54bfaf24361de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:27:28.756711 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-2c834f2d-5a9c-4ff3-8838-db95249ae982 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] 10.222.0.46 "GET /compute/v2.1/servers/b7dd37ec-81bf-4c77-90dc-eecb897d9d19" status: 200 len: 1367 microversion: 2.1 time: 0.166793 Aug 04 05:27:28.757309 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 136/269] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:27:28 2022] GET /compute/v2.1/servers/b7dd37ec-81bf-4c77-90dc-eecb897d9d19 => generated 1367 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 05:27:28.877025 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-5f0954e8-e5b0-4cd8-ad7c-4272c1cf19d0 tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:27:28.877631 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-5f0954e8-e5b0-4cd8-ad7c-4272c1cf19d0 tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] [instance: 48918fad-f7cb-4350-8ecf-e5f803fda4dd] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:27:28.885322 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-5f0954e8-e5b0-4cd8-ad7c-4272c1cf19d0 tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:27:28.885769 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-5f0954e8-e5b0-4cd8-ad7c-4272c1cf19d0 tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:27:28.886556 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-5f0954e8-e5b0-4cd8-ad7c-4272c1cf19d0 tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:27:28.886998 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-5f0954e8-e5b0-4cd8-ad7c-4272c1cf19d0 tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:27:28.957071 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-f118daa1-3634-4d02-b130-12e41da19997 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:27:28.957752 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-f118daa1-3634-4d02-b130-12e41da19997 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] [instance: 178b675e-f4d0-442c-aa69-aece6ea3d636] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:27:28.964625 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-f118daa1-3634-4d02-b130-12e41da19997 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:27:28.965073 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-f118daa1-3634-4d02-b130-12e41da19997 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:27:28.965930 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-f118daa1-3634-4d02-b130-12e41da19997 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:27:28.966387 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-f118daa1-3634-4d02-b130-12e41da19997 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:27:29.059925 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-f118daa1-3634-4d02-b130-12e41da19997 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8f887f5689419e9e31a0ba43f76ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62d19c831574f9b99c993b5e41c645d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:27:29.062286 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-5f0954e8-e5b0-4cd8-ad7c-4272c1cf19d0 tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d384cc766b4ef8bc0498f8fe3e5566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec163b07b5234a48ba80509ac693d8d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:27:29.069336 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-f118daa1-3634-4d02-b130-12e41da19997 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] 10.222.0.46 "GET /compute/v2.1/servers/178b675e-f4d0-442c-aa69-aece6ea3d636" status: 200 len: 1297 microversion: 2.1 time: 0.117175 Aug 04 05:27:29.070012 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 137/270] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:27:28 2022] GET /compute/v2.1/servers/178b675e-f4d0-442c-aa69-aece6ea3d636 => generated 1297 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 05:27:29.074529 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-5f0954e8-e5b0-4cd8-ad7c-4272c1cf19d0 tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] 10.222.0.46 "GET /compute/v2.1/servers/48918fad-f7cb-4350-8ecf-e5f803fda4dd" status: 200 len: 1314 microversion: 2.1 time: 0.196962 Aug 04 05:27:29.074529 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 134/271] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:27:28 2022] GET /compute/v2.1/servers/48918fad-f7cb-4350-8ecf-e5f803fda4dd => generated 1314 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:27:29.778137 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-c35bffc6-dd93-4582-80e7-eb1f60787d7b tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:27:29.778685 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-c35bffc6-dd93-4582-80e7-eb1f60787d7b tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] [instance: b7dd37ec-81bf-4c77-90dc-eecb897d9d19] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:27:29.785185 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-c35bffc6-dd93-4582-80e7-eb1f60787d7b tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:27:29.785632 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-c35bffc6-dd93-4582-80e7-eb1f60787d7b tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:27:29.786441 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-c35bffc6-dd93-4582-80e7-eb1f60787d7b tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:27:29.786880 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-c35bffc6-dd93-4582-80e7-eb1f60787d7b tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:27:29.955819 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-c35bffc6-dd93-4582-80e7-eb1f60787d7b tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb49b631c234f9a9fd47049b9b2e097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faead990837d43de8ec54bfaf24361de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:27:29.964193 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-c35bffc6-dd93-4582-80e7-eb1f60787d7b tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] 10.222.0.46 "GET /compute/v2.1/servers/b7dd37ec-81bf-4c77-90dc-eecb897d9d19" status: 200 len: 1367 microversion: 2.1 time: 0.190660 Aug 04 05:27:29.965014 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 135/272] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:27:29 2022] GET /compute/v2.1/servers/b7dd37ec-81bf-4c77-90dc-eecb897d9d19 => generated 1367 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:27:30.101239 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-82729f8b-9d81-48fd-b9cf-ccc1a00a7780 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:27:30.101851 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-82729f8b-9d81-48fd-b9cf-ccc1a00a7780 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] [instance: 178b675e-f4d0-442c-aa69-aece6ea3d636] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:27:30.106842 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-064cdb6b-aeb1-4151-8124-025c54de2189 tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:27:30.108782 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-064cdb6b-aeb1-4151-8124-025c54de2189 tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] [instance: 48918fad-f7cb-4350-8ecf-e5f803fda4dd] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:27:30.122047 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-82729f8b-9d81-48fd-b9cf-ccc1a00a7780 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:27:30.123430 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-064cdb6b-aeb1-4151-8124-025c54de2189 tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:27:30.124096 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-064cdb6b-aeb1-4151-8124-025c54de2189 tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:27:30.125065 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-064cdb6b-aeb1-4151-8124-025c54de2189 tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:27:30.126534 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-82729f8b-9d81-48fd-b9cf-ccc1a00a7780 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:27:30.127201 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-064cdb6b-aeb1-4151-8124-025c54de2189 tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:27:30.130505 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-82729f8b-9d81-48fd-b9cf-ccc1a00a7780 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:27:30.131109 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-82729f8b-9d81-48fd-b9cf-ccc1a00a7780 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:27:30.547463 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-82729f8b-9d81-48fd-b9cf-ccc1a00a7780 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8f887f5689419e9e31a0ba43f76ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62d19c831574f9b99c993b5e41c645d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:27:30.559531 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-82729f8b-9d81-48fd-b9cf-ccc1a00a7780 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] 10.222.0.46 "GET /compute/v2.1/servers/178b675e-f4d0-442c-aa69-aece6ea3d636" status: 200 len: 1371 microversion: 2.1 time: 0.469969 Aug 04 05:27:30.573030 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 136/273] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:27:30 2022] GET /compute/v2.1/servers/178b675e-f4d0-442c-aa69-aece6ea3d636 => generated 1371 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:27:30.573472 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-064cdb6b-aeb1-4151-8124-025c54de2189 tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d384cc766b4ef8bc0498f8fe3e5566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec163b07b5234a48ba80509ac693d8d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:27:30.573677 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [req-f73393f8-96ed-4e50-9752-dd640bb03d7c req-432e9aa4-e364-4819-9754-3da55c6e9a59 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7dd37ec-81bf-4c77-90dc-eecb897d9d19", "name": "network-vif-plugged", "status": "completed", "tag": "6eecea9c-0ed5-43c6-ad5e-85403bfef11c"}]} {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:27:30.583053 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [req-f73393f8-96ed-4e50-9752-dd640bb03d7c req-432e9aa4-e364-4819-9754-3da55c6e9a59 service nova] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:27:30.583493 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [req-f73393f8-96ed-4e50-9752-dd640bb03d7c req-432e9aa4-e364-4819-9754-3da55c6e9a59 service nova] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:27:30.584777 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-064cdb6b-aeb1-4151-8124-025c54de2189 tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] 10.222.0.46 "GET /compute/v2.1/servers/48918fad-f7cb-4350-8ecf-e5f803fda4dd" status: 200 len: 1314 microversion: 2.1 time: 0.496021 Aug 04 05:27:30.608737 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 138/274] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:27:30 2022] GET /compute/v2.1/servers/48918fad-f7cb-4350-8ecf-e5f803fda4dd => generated 1314 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:27:30.610937 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.compute.server_external_events [req-f73393f8-96ed-4e50-9752-dd640bb03d7c req-432e9aa4-e364-4819-9754-3da55c6e9a59 service nova] Creating event network-vif-plugged:6eecea9c-0ed5-43c6-ad5e-85403bfef11c for instance b7dd37ec-81bf-4c77-90dc-eecb897d9d19 on hv-cinder-85207 Aug 04 05:27:30.620439 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [req-f73393f8-96ed-4e50-9752-dd640bb03d7c req-432e9aa4-e364-4819-9754-3da55c6e9a59 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058614 Aug 04 05:27:30.622725 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 137/275] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Aug 4 05:27:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:27:30.985880 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-b5515f3b-4544-4067-acfd-3e0e16eb0ee1 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:27:30.986551 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-b5515f3b-4544-4067-acfd-3e0e16eb0ee1 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] [instance: b7dd37ec-81bf-4c77-90dc-eecb897d9d19] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:27:30.994343 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-b5515f3b-4544-4067-acfd-3e0e16eb0ee1 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:27:30.995030 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-b5515f3b-4544-4067-acfd-3e0e16eb0ee1 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:27:30.996128 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-b5515f3b-4544-4067-acfd-3e0e16eb0ee1 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:27:30.996576 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-b5515f3b-4544-4067-acfd-3e0e16eb0ee1 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:27:31.333466 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-b5515f3b-4544-4067-acfd-3e0e16eb0ee1 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb49b631c234f9a9fd47049b9b2e097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faead990837d43de8ec54bfaf24361de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:27:31.344208 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-b5515f3b-4544-4067-acfd-3e0e16eb0ee1 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] 10.222.0.46 "GET /compute/v2.1/servers/b7dd37ec-81bf-4c77-90dc-eecb897d9d19" status: 200 len: 1367 microversion: 2.1 time: 0.362320 Aug 04 05:27:31.358088 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 139/276] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:27:30 2022] GET /compute/v2.1/servers/b7dd37ec-81bf-4c77-90dc-eecb897d9d19 => generated 1367 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:27:31.624971 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-9f7239e2-4c01-4b54-b9f6-19f500a0c19b tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:27:31.624971 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-9f7239e2-4c01-4b54-b9f6-19f500a0c19b tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] [instance: 178b675e-f4d0-442c-aa69-aece6ea3d636] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:27:31.624971 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-9f7239e2-4c01-4b54-b9f6-19f500a0c19b tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:27:31.624971 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-9f7239e2-4c01-4b54-b9f6-19f500a0c19b tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:27:31.625605 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-9f7239e2-4c01-4b54-b9f6-19f500a0c19b tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:27:31.625605 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-9f7239e2-4c01-4b54-b9f6-19f500a0c19b tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:27:31.625862 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-86ca617b-507a-4455-8ae4-6cf81afbc45f tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:27:31.625862 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-86ca617b-507a-4455-8ae4-6cf81afbc45f tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] [instance: 48918fad-f7cb-4350-8ecf-e5f803fda4dd] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:27:31.637897 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-86ca617b-507a-4455-8ae4-6cf81afbc45f tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:27:31.638955 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-86ca617b-507a-4455-8ae4-6cf81afbc45f tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:27:31.640159 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-86ca617b-507a-4455-8ae4-6cf81afbc45f tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:27:31.640976 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-86ca617b-507a-4455-8ae4-6cf81afbc45f tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:27:31.816340 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-9f7239e2-4c01-4b54-b9f6-19f500a0c19b tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8f887f5689419e9e31a0ba43f76ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62d19c831574f9b99c993b5e41c645d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:27:31.824856 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-9f7239e2-4c01-4b54-b9f6-19f500a0c19b tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] 10.222.0.46 "GET /compute/v2.1/servers/178b675e-f4d0-442c-aa69-aece6ea3d636" status: 200 len: 1371 microversion: 2.1 time: 0.245642 Aug 04 05:27:31.825449 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 138/277] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:27:31 2022] GET /compute/v2.1/servers/178b675e-f4d0-442c-aa69-aece6ea3d636 => generated 1371 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:27:31.867295 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-86ca617b-507a-4455-8ae4-6cf81afbc45f tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d384cc766b4ef8bc0498f8fe3e5566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec163b07b5234a48ba80509ac693d8d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:27:31.876411 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-86ca617b-507a-4455-8ae4-6cf81afbc45f tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] 10.222.0.46 "GET /compute/v2.1/servers/48918fad-f7cb-4350-8ecf-e5f803fda4dd" status: 200 len: 1314 microversion: 2.1 time: 0.258370 Aug 04 05:27:31.876883 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 140/278] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:27:31 2022] GET /compute/v2.1/servers/48918fad-f7cb-4350-8ecf-e5f803fda4dd => generated 1314 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 05:27:31.915507 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [req-9530be89-06c6-4150-b106-0c399cfb2a66 req-82ad47e0-c060-4982-9b5c-2045734481ca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "178b675e-f4d0-442c-aa69-aece6ea3d636", "tag": "ea55da7a-e1dc-47c4-9f10-3c184df3b802"}]} {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:27:31.925243 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [req-9530be89-06c6-4150-b106-0c399cfb2a66 req-82ad47e0-c060-4982-9b5c-2045734481ca service nova] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:27:31.925669 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [req-9530be89-06c6-4150-b106-0c399cfb2a66 req-82ad47e0-c060-4982-9b5c-2045734481ca service nova] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:27:31.937119 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.compute.server_external_events [req-9530be89-06c6-4150-b106-0c399cfb2a66 req-82ad47e0-c060-4982-9b5c-2045734481ca service nova] Creating event network-changed:ea55da7a-e1dc-47c4-9f10-3c184df3b802 for instance 178b675e-f4d0-442c-aa69-aece6ea3d636 on hv-cinder-85207 Aug 04 05:27:31.941910 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [req-9530be89-06c6-4150-b106-0c399cfb2a66 req-82ad47e0-c060-4982-9b5c-2045734481ca service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030971 Aug 04 05:27:31.942616 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 139/279] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Aug 4 05:27:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 05:27:32.366284 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-05b56fdb-2320-4435-8199-3d3f114d9264 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:27:32.366897 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-05b56fdb-2320-4435-8199-3d3f114d9264 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] [instance: b7dd37ec-81bf-4c77-90dc-eecb897d9d19] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:27:32.374954 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-05b56fdb-2320-4435-8199-3d3f114d9264 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:27:32.375459 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-05b56fdb-2320-4435-8199-3d3f114d9264 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:27:32.376251 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-05b56fdb-2320-4435-8199-3d3f114d9264 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:27:32.376703 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-05b56fdb-2320-4435-8199-3d3f114d9264 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:27:32.577182 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-05b56fdb-2320-4435-8199-3d3f114d9264 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb49b631c234f9a9fd47049b9b2e097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faead990837d43de8ec54bfaf24361de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:27:32.584941 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-05b56fdb-2320-4435-8199-3d3f114d9264 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] 10.222.0.46 "GET /compute/v2.1/servers/b7dd37ec-81bf-4c77-90dc-eecb897d9d19" status: 200 len: 1367 microversion: 2.1 time: 0.222596 Aug 04 05:27:32.585519 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 141/280] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:27:32 2022] GET /compute/v2.1/servers/b7dd37ec-81bf-4c77-90dc-eecb897d9d19 => generated 1367 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:27:32.669510 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [req-4e43b6ad-6b66-49b0-9185-ee14d85f3132 req-a147e160-354f-41b5-91bc-a9beb8af0142 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "48918fad-f7cb-4350-8ecf-e5f803fda4dd", "name": "network-vif-plugged", "status": "completed", "tag": "67598c9d-5f55-4d52-a8ef-68e91a202a41"}]} {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:27:32.683827 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [req-4e43b6ad-6b66-49b0-9185-ee14d85f3132 req-a147e160-354f-41b5-91bc-a9beb8af0142 service nova] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:27:32.684171 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [req-4e43b6ad-6b66-49b0-9185-ee14d85f3132 req-a147e160-354f-41b5-91bc-a9beb8af0142 service nova] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:27:32.696240 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.compute.server_external_events [req-4e43b6ad-6b66-49b0-9185-ee14d85f3132 req-a147e160-354f-41b5-91bc-a9beb8af0142 service nova] Creating event network-vif-plugged:67598c9d-5f55-4d52-a8ef-68e91a202a41 for instance 48918fad-f7cb-4350-8ecf-e5f803fda4dd on hv-cinder-85207 Aug 04 05:27:32.701244 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [req-4e43b6ad-6b66-49b0-9185-ee14d85f3132 req-a147e160-354f-41b5-91bc-a9beb8af0142 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036525 Aug 04 05:27:32.701834 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 140/281] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Aug 4 05:27:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 05:27:32.846932 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-2c262144-dcf1-4277-93a4-a27d49b0ac7b tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:27:32.847544 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-2c262144-dcf1-4277-93a4-a27d49b0ac7b tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] [instance: 178b675e-f4d0-442c-aa69-aece6ea3d636] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:27:32.854880 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-2c262144-dcf1-4277-93a4-a27d49b0ac7b tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:27:32.855330 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-2c262144-dcf1-4277-93a4-a27d49b0ac7b tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:27:32.856108 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-2c262144-dcf1-4277-93a4-a27d49b0ac7b tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:27:32.856544 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-2c262144-dcf1-4277-93a4-a27d49b0ac7b tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:27:32.901254 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-651f4626-29f6-40ec-bed8-ef6592759b36 tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:27:32.902119 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-651f4626-29f6-40ec-bed8-ef6592759b36 tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] [instance: 48918fad-f7cb-4350-8ecf-e5f803fda4dd] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:27:32.909376 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-651f4626-29f6-40ec-bed8-ef6592759b36 tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:27:32.909844 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-651f4626-29f6-40ec-bed8-ef6592759b36 tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:27:32.910863 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-651f4626-29f6-40ec-bed8-ef6592759b36 tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:27:32.911298 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-651f4626-29f6-40ec-bed8-ef6592759b36 tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:27:33.065760 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-2c262144-dcf1-4277-93a4-a27d49b0ac7b tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8f887f5689419e9e31a0ba43f76ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62d19c831574f9b99c993b5e41c645d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:27:33.075113 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-2c262144-dcf1-4277-93a4-a27d49b0ac7b tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] 10.222.0.46 "GET /compute/v2.1/servers/178b675e-f4d0-442c-aa69-aece6ea3d636" status: 200 len: 1371 microversion: 2.1 time: 0.231942 Aug 04 05:27:33.075810 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 142/282] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:27:32 2022] GET /compute/v2.1/servers/178b675e-f4d0-442c-aa69-aece6ea3d636 => generated 1371 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:27:33.096542 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-651f4626-29f6-40ec-bed8-ef6592759b36 tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d384cc766b4ef8bc0498f8fe3e5566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec163b07b5234a48ba80509ac693d8d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:27:33.105781 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-651f4626-29f6-40ec-bed8-ef6592759b36 tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] 10.222.0.46 "GET /compute/v2.1/servers/48918fad-f7cb-4350-8ecf-e5f803fda4dd" status: 200 len: 1314 microversion: 2.1 time: 0.210285 Aug 04 05:27:33.106373 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 141/283] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:27:32 2022] GET /compute/v2.1/servers/48918fad-f7cb-4350-8ecf-e5f803fda4dd => generated 1314 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 05:27:33.573597 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-320d6fd5-4855-48bf-9c99-a03c7da1194d tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1334008613", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-564503341", "security_groups": [{"name": "tempest-secgroup-smoke-927884223"}], "networks": [{"uuid": "d5f27db1-09fd-424d-92c0-0ac4a620cdc5"}], "block_device_mapping_v2": [{"uuid": "eb5767f2-192e-4533-9ddd-c474c96d4862", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:27:33.606605 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-1bf1a745-5c48-4839-b66e-4c7a33dcf6dc tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:27:33.607640 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-1bf1a745-5c48-4839-b66e-4c7a33dcf6dc tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] [instance: b7dd37ec-81bf-4c77-90dc-eecb897d9d19] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:27:33.624330 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-1bf1a745-5c48-4839-b66e-4c7a33dcf6dc tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:27:33.624998 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-1bf1a745-5c48-4839-b66e-4c7a33dcf6dc tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:27:33.625878 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-1bf1a745-5c48-4839-b66e-4c7a33dcf6dc tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:27:33.626340 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-1bf1a745-5c48-4839-b66e-4c7a33dcf6dc tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:27:33.861502 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.network.neutron [None req-320d6fd5-4855-48bf-9c99-a03c7da1194d tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] validate_networks() for [('d5f27db1-09fd-424d-92c0-0ac4a620cdc5', None, None, None, None, None)] {{(pid=118476) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 05:27:33.963944 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-1bf1a745-5c48-4839-b66e-4c7a33dcf6dc tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb49b631c234f9a9fd47049b9b2e097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faead990837d43de8ec54bfaf24361de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:27:33.973246 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-1bf1a745-5c48-4839-b66e-4c7a33dcf6dc tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] 10.222.0.46 "GET /compute/v2.1/servers/b7dd37ec-81bf-4c77-90dc-eecb897d9d19" status: 200 len: 1557 microversion: 2.1 time: 0.371435 Aug 04 05:27:33.973882 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 142/284] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:27:33 2022] GET /compute/v2.1/servers/b7dd37ec-81bf-4c77-90dc-eecb897d9d19 => generated 1557 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:27:33.995612 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-318cc525-c840-499b-a977-52a227f873bc tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:27:33.998652 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-318cc525-c840-499b-a977-52a227f873bc tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] [instance: b7dd37ec-81bf-4c77-90dc-eecb897d9d19] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:27:34.002578 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-318cc525-c840-499b-a977-52a227f873bc tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:27:34.003024 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-318cc525-c840-499b-a977-52a227f873bc tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:27:34.003792 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-318cc525-c840-499b-a977-52a227f873bc tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:27:34.004232 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-318cc525-c840-499b-a977-52a227f873bc tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:27:34.123808 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-318cc525-c840-499b-a977-52a227f873bc tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] 10.222.0.46 "GET /compute/v2.1/servers/b7dd37ec-81bf-4c77-90dc-eecb897d9d19/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.132701 Aug 04 05:27:34.124433 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 143/285] 10.222.0.46 () {58 vars in 1275 bytes} [Thu Aug 4 05:27:33 2022] GET /compute/v2.1/servers/b7dd37ec-81bf-4c77-90dc-eecb897d9d19/os-interface => generated 284 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:27:34.129138 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-5779109c-3c9a-45f2-9dc4-74227e73172e tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:27:34.130005 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-5779109c-3c9a-45f2-9dc4-74227e73172e tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] [instance: 178b675e-f4d0-442c-aa69-aece6ea3d636] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:27:34.144008 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-5779109c-3c9a-45f2-9dc4-74227e73172e tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:27:34.144455 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-5779109c-3c9a-45f2-9dc4-74227e73172e tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:27:34.145296 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-5779109c-3c9a-45f2-9dc4-74227e73172e tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:27:34.145732 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-5779109c-3c9a-45f2-9dc4-74227e73172e tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:27:34.725351 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-5779109c-3c9a-45f2-9dc4-74227e73172e tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8f887f5689419e9e31a0ba43f76ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62d19c831574f9b99c993b5e41c645d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:27:34.735766 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-5779109c-3c9a-45f2-9dc4-74227e73172e tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] 10.222.0.46 "GET /compute/v2.1/servers/178b675e-f4d0-442c-aa69-aece6ea3d636" status: 200 len: 1371 microversion: 2.1 time: 0.610233 Aug 04 05:27:34.736540 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 144/286] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:27:34 2022] GET /compute/v2.1/servers/178b675e-f4d0-442c-aa69-aece6ea3d636 => generated 1371 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:27:34.744865 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-23144cf4-60ba-4764-8e6c-d32364d9ba12 tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:27:34.744865 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-23144cf4-60ba-4764-8e6c-d32364d9ba12 tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] [instance: 48918fad-f7cb-4350-8ecf-e5f803fda4dd] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:27:34.754705 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-23144cf4-60ba-4764-8e6c-d32364d9ba12 tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:27:34.759387 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-23144cf4-60ba-4764-8e6c-d32364d9ba12 tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:27:34.760455 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-23144cf4-60ba-4764-8e6c-d32364d9ba12 tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:27:34.761055 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-23144cf4-60ba-4764-8e6c-d32364d9ba12 tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:27:34.803748 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.virt.hardware [None req-320d6fd5-4855-48bf-9c99-a03c7da1194d tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Flavor limits 0:0:0 {{(pid=118476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 05:27:34.804273 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.virt.hardware [None req-320d6fd5-4855-48bf-9c99-a03c7da1194d tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Image limits 0:0:0 {{(pid=118476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 05:27:34.804623 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.virt.hardware [None req-320d6fd5-4855-48bf-9c99-a03c7da1194d tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Flavor pref 0:0:0 {{(pid=118476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 05:27:34.805905 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.virt.hardware [None req-320d6fd5-4855-48bf-9c99-a03c7da1194d tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Image pref 0:0:0 {{(pid=118476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 05:27:34.806619 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.virt.hardware [None req-320d6fd5-4855-48bf-9c99-a03c7da1194d tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 05:27:34.819836 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-320d6fd5-4855-48bf-9c99-a03c7da1194d tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:27:34.821959 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-320d6fd5-4855-48bf-9c99-a03c7da1194d tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:27:34.825257 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-320d6fd5-4855-48bf-9c99-a03c7da1194d tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:27:34.832319 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-320d6fd5-4855-48bf-9c99-a03c7da1194d tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:27:34.867367 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.quota [None req-320d6fd5-4855-48bf-9c99-a03c7da1194d tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Getting quotas for project e32569df1dca45cebcdd63d03ff5abae. Resources: {'instances', 'cores', 'ram'} {{(pid=118476) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 05:27:34.873030 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.quota [None req-320d6fd5-4855-48bf-9c99-a03c7da1194d tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Getting quotas for user 965cf2aad5bc4def9fca55aac87cc37e and project e32569df1dca45cebcdd63d03ff5abae. Resources: {'instances', 'cores', 'ram'} {{(pid=118476) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 05:27:34.945159 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-320d6fd5-4855-48bf-9c99-a03c7da1194d tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Going to run 1 instances... {{(pid=118476) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 05:27:34.948649 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-320d6fd5-4855-48bf-9c99-a03c7da1194d tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] [instance: 8558ff08-5004-4dc4-892d-5b6610ce6bec] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='eb5767f2-192e-4533-9ddd-c474c96d4862',volume_size=None,volume_type=None)] {{(pid=118476) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 05:27:34.951642 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-23144cf4-60ba-4764-8e6c-d32364d9ba12 tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d384cc766b4ef8bc0498f8fe3e5566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec163b07b5234a48ba80509ac693d8d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:27:34.959847 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-23144cf4-60ba-4764-8e6c-d32364d9ba12 tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] 10.222.0.46 "GET /compute/v2.1/servers/48918fad-f7cb-4350-8ecf-e5f803fda4dd" status: 200 len: 1314 microversion: 2.1 time: 0.222007 Aug 04 05:27:34.960602 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 145/287] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:27:34 2022] GET /compute/v2.1/servers/48918fad-f7cb-4350-8ecf-e5f803fda4dd => generated 1314 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:27:35.275837 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [req-f31cfc79-7fce-4a50-8839-0a535313f61d req-18a74518-e4d6-4b8a-93a7-9cd2378684d3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b7dd37ec-81bf-4c77-90dc-eecb897d9d19", "tag": "6eecea9c-0ed5-43c6-ad5e-85403bfef11c"}]} {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:27:35.287788 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [req-f31cfc79-7fce-4a50-8839-0a535313f61d req-18a74518-e4d6-4b8a-93a7-9cd2378684d3 service nova] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:27:35.288537 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [req-f31cfc79-7fce-4a50-8839-0a535313f61d req-18a74518-e4d6-4b8a-93a7-9cd2378684d3 service nova] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:27:35.309534 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.compute.server_external_events [req-f31cfc79-7fce-4a50-8839-0a535313f61d req-18a74518-e4d6-4b8a-93a7-9cd2378684d3 service nova] Creating event network-changed:6eecea9c-0ed5-43c6-ad5e-85403bfef11c for instance b7dd37ec-81bf-4c77-90dc-eecb897d9d19 on hv-cinder-85207 Aug 04 05:27:35.318296 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [req-f31cfc79-7fce-4a50-8839-0a535313f61d req-18a74518-e4d6-4b8a-93a7-9cd2378684d3 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047089 Aug 04 05:27:35.324052 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 146/288] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Aug 4 05:27:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 05:27:35.487135 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-320d6fd5-4855-48bf-9c99-a03c7da1194d tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.918213 Aug 04 05:27:35.487989 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 143/289] 10.222.0.46 () {60 vars in 1147 bytes} [Thu Aug 4 05:27:33 2022] POST /compute/v2.1/servers => generated 405 bytes in 1920 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 04 05:27:35.500534 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-76d63d41-8dac-48a6-a5a8-9a4fed96879d tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:27:35.501386 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-76d63d41-8dac-48a6-a5a8-9a4fed96879d tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] [instance: 8558ff08-5004-4dc4-892d-5b6610ce6bec] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:27:35.579010 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-76d63d41-8dac-48a6-a5a8-9a4fed96879d tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965cf2aad5bc4def9fca55aac87cc37e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32569df1dca45cebcdd63d03ff5abae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:27:35.593814 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-76d63d41-8dac-48a6-a5a8-9a4fed96879d tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] 10.222.0.46 "GET /compute/v2.1/servers/8558ff08-5004-4dc4-892d-5b6610ce6bec" status: 200 len: 1088 microversion: 2.1 time: 0.097312 Aug 04 05:27:35.595430 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 147/290] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:27:35 2022] GET /compute/v2.1/servers/8558ff08-5004-4dc4-892d-5b6610ce6bec => generated 1088 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:27:35.761813 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-0bbfea76-c052-45be-84eb-9335c1e82355 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:27:35.762383 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-0bbfea76-c052-45be-84eb-9335c1e82355 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] [instance: 178b675e-f4d0-442c-aa69-aece6ea3d636] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:27:35.768527 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-0bbfea76-c052-45be-84eb-9335c1e82355 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:27:35.768978 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-0bbfea76-c052-45be-84eb-9335c1e82355 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:27:35.769749 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-0bbfea76-c052-45be-84eb-9335c1e82355 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:27:35.770249 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-0bbfea76-c052-45be-84eb-9335c1e82355 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:27:35.947840 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-0bbfea76-c052-45be-84eb-9335c1e82355 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8f887f5689419e9e31a0ba43f76ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62d19c831574f9b99c993b5e41c645d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:27:35.956010 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-0bbfea76-c052-45be-84eb-9335c1e82355 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] 10.222.0.46 "GET /compute/v2.1/servers/178b675e-f4d0-442c-aa69-aece6ea3d636" status: 200 len: 1371 microversion: 2.1 time: 0.198446 Aug 04 05:27:35.956664 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 144/291] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:27:35 2022] GET /compute/v2.1/servers/178b675e-f4d0-442c-aa69-aece6ea3d636 => generated 1371 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:27:35.981479 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-c663f85c-7334-47a1-adb3-b448f443f45e tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:27:35.982096 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-c663f85c-7334-47a1-adb3-b448f443f45e tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] [instance: 48918fad-f7cb-4350-8ecf-e5f803fda4dd] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:27:35.989631 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-c663f85c-7334-47a1-adb3-b448f443f45e tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:27:35.990080 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-c663f85c-7334-47a1-adb3-b448f443f45e tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:27:35.990936 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-c663f85c-7334-47a1-adb3-b448f443f45e tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:27:35.991375 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-c663f85c-7334-47a1-adb3-b448f443f45e tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:27:36.177074 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-c663f85c-7334-47a1-adb3-b448f443f45e tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d384cc766b4ef8bc0498f8fe3e5566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec163b07b5234a48ba80509ac693d8d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:27:36.187783 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-c663f85c-7334-47a1-adb3-b448f443f45e tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] 10.222.0.46 "GET /compute/v2.1/servers/48918fad-f7cb-4350-8ecf-e5f803fda4dd" status: 200 len: 1314 microversion: 2.1 time: 0.210617 Aug 04 05:27:36.188365 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 148/292] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:27:35 2022] GET /compute/v2.1/servers/48918fad-f7cb-4350-8ecf-e5f803fda4dd => generated 1314 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:27:36.617692 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-646b5147-1d75-4851-b049-df2e36352d40 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:27:36.618768 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-646b5147-1d75-4851-b049-df2e36352d40 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] [instance: 8558ff08-5004-4dc4-892d-5b6610ce6bec] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:27:36.684842 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-646b5147-1d75-4851-b049-df2e36352d40 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965cf2aad5bc4def9fca55aac87cc37e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32569df1dca45cebcdd63d03ff5abae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:27:36.692246 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-646b5147-1d75-4851-b049-df2e36352d40 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] 10.222.0.46 "GET /compute/v2.1/servers/8558ff08-5004-4dc4-892d-5b6610ce6bec" status: 200 len: 1088 microversion: 2.1 time: 0.079512 Aug 04 05:27:36.694500 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 145/293] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:27:36 2022] GET /compute/v2.1/servers/8558ff08-5004-4dc4-892d-5b6610ce6bec => generated 1088 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:27:36.983835 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-8443c25b-d61f-4086-bb51-be8b3090fcbe tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:27:36.984446 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-8443c25b-d61f-4086-bb51-be8b3090fcbe tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] [instance: 178b675e-f4d0-442c-aa69-aece6ea3d636] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:27:36.986542 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG dbcounter [-] [118477] Writing DB stats nova_cell0:SELECT=2 {{(pid=118477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:27:36.991927 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-8443c25b-d61f-4086-bb51-be8b3090fcbe tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:27:36.992371 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-8443c25b-d61f-4086-bb51-be8b3090fcbe tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:27:36.993803 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-8443c25b-d61f-4086-bb51-be8b3090fcbe tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:27:36.994251 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-8443c25b-d61f-4086-bb51-be8b3090fcbe tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:27:37.210541 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-c5d7d119-bc31-4010-a914-5fef6cabd3c1 tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:27:37.210541 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-c5d7d119-bc31-4010-a914-5fef6cabd3c1 tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] [instance: 48918fad-f7cb-4350-8ecf-e5f803fda4dd] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:27:37.217752 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-c5d7d119-bc31-4010-a914-5fef6cabd3c1 tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:27:37.218126 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-c5d7d119-bc31-4010-a914-5fef6cabd3c1 tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:27:37.218932 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-c5d7d119-bc31-4010-a914-5fef6cabd3c1 tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:27:37.219426 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-c5d7d119-bc31-4010-a914-5fef6cabd3c1 tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:27:37.222397 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-8443c25b-d61f-4086-bb51-be8b3090fcbe tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8f887f5689419e9e31a0ba43f76ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62d19c831574f9b99c993b5e41c645d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:27:37.225135 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG dbcounter [-] [118477] Writing DB stats nova_cell1:SELECT=100 {{(pid=118477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:27:37.233626 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-8443c25b-d61f-4086-bb51-be8b3090fcbe tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] 10.222.0.46 "GET /compute/v2.1/servers/178b675e-f4d0-442c-aa69-aece6ea3d636" status: 200 len: 1371 microversion: 2.1 time: 0.253651 Aug 04 05:27:37.234541 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 149/294] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:27:36 2022] GET /compute/v2.1/servers/178b675e-f4d0-442c-aa69-aece6ea3d636 => generated 1371 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:27:37.468527 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-c5d7d119-bc31-4010-a914-5fef6cabd3c1 tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d384cc766b4ef8bc0498f8fe3e5566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec163b07b5234a48ba80509ac693d8d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:27:37.476803 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-c5d7d119-bc31-4010-a914-5fef6cabd3c1 tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] 10.222.0.46 "GET /compute/v2.1/servers/48918fad-f7cb-4350-8ecf-e5f803fda4dd" status: 200 len: 1497 microversion: 2.1 time: 0.270896 Aug 04 05:27:37.478211 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 146/295] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:27:37 2022] GET /compute/v2.1/servers/48918fad-f7cb-4350-8ecf-e5f803fda4dd => generated 1497 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 05:27:37.714749 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-f5f52a3f-5183-4534-a9d0-bf7ee9d11d2a tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:27:37.715263 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-f5f52a3f-5183-4534-a9d0-bf7ee9d11d2a tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] [instance: 8558ff08-5004-4dc4-892d-5b6610ce6bec] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:27:37.721442 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-f5f52a3f-5183-4534-a9d0-bf7ee9d11d2a tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:27:37.721901 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-f5f52a3f-5183-4534-a9d0-bf7ee9d11d2a tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:27:37.723270 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-f5f52a3f-5183-4534-a9d0-bf7ee9d11d2a tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:27:37.723412 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-f5f52a3f-5183-4534-a9d0-bf7ee9d11d2a tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:27:37.793890 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-f5f52a3f-5183-4534-a9d0-bf7ee9d11d2a tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965cf2aad5bc4def9fca55aac87cc37e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32569df1dca45cebcdd63d03ff5abae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:27:37.801347 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-f5f52a3f-5183-4534-a9d0-bf7ee9d11d2a tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] 10.222.0.46 "GET /compute/v2.1/servers/8558ff08-5004-4dc4-892d-5b6610ce6bec" status: 200 len: 1186 microversion: 2.1 time: 0.092034 Aug 04 05:27:37.801918 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 150/296] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:27:37 2022] GET /compute/v2.1/servers/8558ff08-5004-4dc4-892d-5b6610ce6bec => generated 1186 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:27:38.255886 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-53ba52df-ece7-47d9-ba46-d294d3dcf29c tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:27:38.256524 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-53ba52df-ece7-47d9-ba46-d294d3dcf29c tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] [instance: 178b675e-f4d0-442c-aa69-aece6ea3d636] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:27:38.263334 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-53ba52df-ece7-47d9-ba46-d294d3dcf29c tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:27:38.263869 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-53ba52df-ece7-47d9-ba46-d294d3dcf29c tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:27:38.264704 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-53ba52df-ece7-47d9-ba46-d294d3dcf29c tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:27:38.265233 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-53ba52df-ece7-47d9-ba46-d294d3dcf29c tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:27:38.494744 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-53ba52df-ece7-47d9-ba46-d294d3dcf29c tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8f887f5689419e9e31a0ba43f76ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62d19c831574f9b99c993b5e41c645d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:27:38.498128 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG dbcounter [-] [118476] Writing DB stats nova_cell1:SELECT=100 {{(pid=118476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:27:38.503343 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-53ba52df-ece7-47d9-ba46-d294d3dcf29c tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] 10.222.0.46 "GET /compute/v2.1/servers/178b675e-f4d0-442c-aa69-aece6ea3d636" status: 200 len: 1371 microversion: 2.1 time: 0.251574 Aug 04 05:27:38.503930 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 147/297] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:27:38 2022] GET /compute/v2.1/servers/178b675e-f4d0-442c-aa69-aece6ea3d636 => generated 1371 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:27:38.604962 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-8c2503ba-fcfc-4687-96c3-68da02d0bea3 tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:27:38.605472 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-8c2503ba-fcfc-4687-96c3-68da02d0bea3 tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] [instance: 48918fad-f7cb-4350-8ecf-e5f803fda4dd] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:27:38.612232 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-8c2503ba-fcfc-4687-96c3-68da02d0bea3 tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:27:38.612679 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-8c2503ba-fcfc-4687-96c3-68da02d0bea3 tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:27:38.615407 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-8c2503ba-fcfc-4687-96c3-68da02d0bea3 tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:27:38.615407 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-8c2503ba-fcfc-4687-96c3-68da02d0bea3 tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:27:38.640785 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-8c2503ba-fcfc-4687-96c3-68da02d0bea3 tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] [instance: 48918fad-f7cb-4350-8ecf-e5f803fda4dd] Going to try to terminate instance {{(pid=118477) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 05:27:38.822200 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-9b7160df-2d13-45b2-a811-847050e3ff2a tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:27:38.822719 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-9b7160df-2d13-45b2-a811-847050e3ff2a tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] [instance: 8558ff08-5004-4dc4-892d-5b6610ce6bec] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:27:38.828773 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-9b7160df-2d13-45b2-a811-847050e3ff2a tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:27:38.829217 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-9b7160df-2d13-45b2-a811-847050e3ff2a tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:27:38.829977 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-9b7160df-2d13-45b2-a811-847050e3ff2a tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:27:38.830439 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-9b7160df-2d13-45b2-a811-847050e3ff2a tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:27:38.904665 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-9b7160df-2d13-45b2-a811-847050e3ff2a tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965cf2aad5bc4def9fca55aac87cc37e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32569df1dca45cebcdd63d03ff5abae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:27:38.913459 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-9b7160df-2d13-45b2-a811-847050e3ff2a tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] 10.222.0.46 "GET /compute/v2.1/servers/8558ff08-5004-4dc4-892d-5b6610ce6bec" status: 200 len: 1204 microversion: 2.1 time: 0.095754 Aug 04 05:27:38.914087 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 148/298] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:27:38 2022] GET /compute/v2.1/servers/8558ff08-5004-4dc4-892d-5b6610ce6bec => generated 1204 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 05:27:39.079031 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-8c2503ba-fcfc-4687-96c3-68da02d0bea3 tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] 10.222.0.46 "DELETE /compute/v2.1/servers/48918fad-f7cb-4350-8ecf-e5f803fda4dd" status: 204 len: 0 microversion: 2.1 time: 0.478788 Aug 04 05:27:39.079612 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 151/299] 10.222.0.46 () {58 vars in 1239 bytes} [Thu Aug 4 05:27:38 2022] DELETE /compute/v2.1/servers/48918fad-f7cb-4350-8ecf-e5f803fda4dd => generated 0 bytes in 480 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 05:27:39.088307 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-9694b57b-d047-4dbb-9544-913f2ab66b25 tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:27:39.088915 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-9694b57b-d047-4dbb-9544-913f2ab66b25 tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] [instance: 48918fad-f7cb-4350-8ecf-e5f803fda4dd] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:27:39.095032 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-9694b57b-d047-4dbb-9544-913f2ab66b25 tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:27:39.095479 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-9694b57b-d047-4dbb-9544-913f2ab66b25 tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:27:39.096262 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-9694b57b-d047-4dbb-9544-913f2ab66b25 tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:27:39.096699 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-9694b57b-d047-4dbb-9544-913f2ab66b25 tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:27:39.340518 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-9694b57b-d047-4dbb-9544-913f2ab66b25 tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d384cc766b4ef8bc0498f8fe3e5566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec163b07b5234a48ba80509ac693d8d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:27:39.348658 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-9694b57b-d047-4dbb-9544-913f2ab66b25 tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] 10.222.0.46 "GET /compute/v2.1/servers/48918fad-f7cb-4350-8ecf-e5f803fda4dd" status: 200 len: 1503 microversion: 2.1 time: 0.264655 Aug 04 05:27:39.349339 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 149/300] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:27:39 2022] GET /compute/v2.1/servers/48918fad-f7cb-4350-8ecf-e5f803fda4dd => generated 1503 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:27:39.464709 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [req-a72076af-3eca-4314-a4ab-64c6e0133597 req-60aa16e6-e633-4e0d-b30e-e57d4821ced1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "178b675e-f4d0-442c-aa69-aece6ea3d636", "name": "network-vif-plugged", "status": "completed", "tag": "ea55da7a-e1dc-47c4-9f10-3c184df3b802"}]} {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:27:39.475614 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [req-a72076af-3eca-4314-a4ab-64c6e0133597 req-60aa16e6-e633-4e0d-b30e-e57d4821ced1 service nova] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:27:39.476043 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [req-a72076af-3eca-4314-a4ab-64c6e0133597 req-60aa16e6-e633-4e0d-b30e-e57d4821ced1 service nova] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:27:39.489119 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.compute.server_external_events [req-a72076af-3eca-4314-a4ab-64c6e0133597 req-60aa16e6-e633-4e0d-b30e-e57d4821ced1 service nova] Creating event network-vif-plugged:ea55da7a-e1dc-47c4-9f10-3c184df3b802 for instance 178b675e-f4d0-442c-aa69-aece6ea3d636 on hv-cinder-85207 Aug 04 05:27:39.495479 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [req-a72076af-3eca-4314-a4ab-64c6e0133597 req-60aa16e6-e633-4e0d-b30e-e57d4821ced1 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035837 Aug 04 05:27:39.496106 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 152/301] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Aug 4 05:27:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:27:39.527339 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-9b435edc-7aa5-4309-823d-f3c9ba3d3de4 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:27:39.528054 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-9b435edc-7aa5-4309-823d-f3c9ba3d3de4 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] [instance: 178b675e-f4d0-442c-aa69-aece6ea3d636] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:27:39.534374 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-9b435edc-7aa5-4309-823d-f3c9ba3d3de4 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:27:39.534827 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-9b435edc-7aa5-4309-823d-f3c9ba3d3de4 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:27:39.535598 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-9b435edc-7aa5-4309-823d-f3c9ba3d3de4 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:27:39.536035 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-9b435edc-7aa5-4309-823d-f3c9ba3d3de4 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:27:39.681110 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-9b435edc-7aa5-4309-823d-f3c9ba3d3de4 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8f887f5689419e9e31a0ba43f76ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62d19c831574f9b99c993b5e41c645d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:27:39.688712 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-9b435edc-7aa5-4309-823d-f3c9ba3d3de4 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] 10.222.0.46 "GET /compute/v2.1/servers/178b675e-f4d0-442c-aa69-aece6ea3d636" status: 200 len: 1371 microversion: 2.1 time: 0.166161 Aug 04 05:27:39.689296 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 150/302] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:27:39 2022] GET /compute/v2.1/servers/178b675e-f4d0-442c-aa69-aece6ea3d636 => generated 1371 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 05:27:39.936812 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-b799919d-a5d9-4177-a501-3f973dadd13f tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:27:39.937503 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-b799919d-a5d9-4177-a501-3f973dadd13f tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] [instance: 8558ff08-5004-4dc4-892d-5b6610ce6bec] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:27:39.944284 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-b799919d-a5d9-4177-a501-3f973dadd13f tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:27:39.944722 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-b799919d-a5d9-4177-a501-3f973dadd13f tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:27:39.946176 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-b799919d-a5d9-4177-a501-3f973dadd13f tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:27:39.946780 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-b799919d-a5d9-4177-a501-3f973dadd13f tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:27:40.092814 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-b799919d-a5d9-4177-a501-3f973dadd13f tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965cf2aad5bc4def9fca55aac87cc37e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32569df1dca45cebcdd63d03ff5abae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:27:40.100599 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-b799919d-a5d9-4177-a501-3f973dadd13f tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] 10.222.0.46 "GET /compute/v2.1/servers/8558ff08-5004-4dc4-892d-5b6610ce6bec" status: 200 len: 1271 microversion: 2.1 time: 0.168198 Aug 04 05:27:40.101587 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 153/303] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:27:39 2022] GET /compute/v2.1/servers/8558ff08-5004-4dc4-892d-5b6610ce6bec => generated 1271 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:27:40.373165 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-1c9afcb1-8ded-4f30-bdb2-eda86d74517b tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:27:40.373967 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-1c9afcb1-8ded-4f30-bdb2-eda86d74517b tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] [instance: 48918fad-f7cb-4350-8ecf-e5f803fda4dd] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:27:40.382277 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-1c9afcb1-8ded-4f30-bdb2-eda86d74517b tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:27:40.382822 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-1c9afcb1-8ded-4f30-bdb2-eda86d74517b tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:27:40.385065 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-1c9afcb1-8ded-4f30-bdb2-eda86d74517b tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:27:40.385725 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-1c9afcb1-8ded-4f30-bdb2-eda86d74517b tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:27:40.575473 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-1c9afcb1-8ded-4f30-bdb2-eda86d74517b tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d384cc766b4ef8bc0498f8fe3e5566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec163b07b5234a48ba80509ac693d8d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:27:40.587668 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-1c9afcb1-8ded-4f30-bdb2-eda86d74517b tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] 10.222.0.46 "GET /compute/v2.1/servers/48918fad-f7cb-4350-8ecf-e5f803fda4dd" status: 200 len: 1503 microversion: 2.1 time: 0.216290 Aug 04 05:27:40.587668 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 151/304] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:27:40 2022] GET /compute/v2.1/servers/48918fad-f7cb-4350-8ecf-e5f803fda4dd => generated 1503 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:27:40.711044 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-6b36f1a5-52c3-4b1d-9c49-0607846078c2 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:27:40.712275 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-6b36f1a5-52c3-4b1d-9c49-0607846078c2 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] [instance: 178b675e-f4d0-442c-aa69-aece6ea3d636] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:27:40.718979 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-6b36f1a5-52c3-4b1d-9c49-0607846078c2 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:27:40.724109 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-6b36f1a5-52c3-4b1d-9c49-0607846078c2 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:27:40.724109 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-6b36f1a5-52c3-4b1d-9c49-0607846078c2 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:27:40.724109 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-6b36f1a5-52c3-4b1d-9c49-0607846078c2 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:27:40.986229 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-6b36f1a5-52c3-4b1d-9c49-0607846078c2 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8f887f5689419e9e31a0ba43f76ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62d19c831574f9b99c993b5e41c645d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:27:40.995843 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-6b36f1a5-52c3-4b1d-9c49-0607846078c2 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] 10.222.0.46 "GET /compute/v2.1/servers/178b675e-f4d0-442c-aa69-aece6ea3d636" status: 200 len: 1371 microversion: 2.1 time: 0.288996 Aug 04 05:27:40.997208 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 154/305] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:27:40 2022] GET /compute/v2.1/servers/178b675e-f4d0-442c-aa69-aece6ea3d636 => generated 1371 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:27:41.123769 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-16e6b918-1d64-4a4e-9aff-354ea2287ed3 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:27:41.124387 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-16e6b918-1d64-4a4e-9aff-354ea2287ed3 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] [instance: 8558ff08-5004-4dc4-892d-5b6610ce6bec] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:27:41.130995 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-16e6b918-1d64-4a4e-9aff-354ea2287ed3 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:27:41.131385 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-16e6b918-1d64-4a4e-9aff-354ea2287ed3 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:27:41.132146 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-16e6b918-1d64-4a4e-9aff-354ea2287ed3 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:27:41.132737 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-16e6b918-1d64-4a4e-9aff-354ea2287ed3 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:27:41.391567 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-16e6b918-1d64-4a4e-9aff-354ea2287ed3 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965cf2aad5bc4def9fca55aac87cc37e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32569df1dca45cebcdd63d03ff5abae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:27:41.401783 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-16e6b918-1d64-4a4e-9aff-354ea2287ed3 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] 10.222.0.46 "GET /compute/v2.1/servers/8558ff08-5004-4dc4-892d-5b6610ce6bec" status: 200 len: 1271 microversion: 2.1 time: 0.281763 Aug 04 05:27:41.402327 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 152/306] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:27:41 2022] GET /compute/v2.1/servers/8558ff08-5004-4dc4-892d-5b6610ce6bec => generated 1271 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:27:41.520472 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [req-a4f8f03e-5995-4955-92ca-ffce2fd761bd req-ba93688d-40d2-4947-ae8e-8b49ac9334db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "48918fad-f7cb-4350-8ecf-e5f803fda4dd", "name": "network-vif-deleted", "tag": "67598c9d-5f55-4d52-a8ef-68e91a202a41"}]} {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:27:41.530078 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [req-a4f8f03e-5995-4955-92ca-ffce2fd761bd req-ba93688d-40d2-4947-ae8e-8b49ac9334db service nova] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:27:41.530548 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [req-a4f8f03e-5995-4955-92ca-ffce2fd761bd req-ba93688d-40d2-4947-ae8e-8b49ac9334db service nova] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:27:41.542990 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.compute.server_external_events [req-a4f8f03e-5995-4955-92ca-ffce2fd761bd req-ba93688d-40d2-4947-ae8e-8b49ac9334db service nova] Creating event network-vif-deleted:67598c9d-5f55-4d52-a8ef-68e91a202a41 for instance 48918fad-f7cb-4350-8ecf-e5f803fda4dd on hv-cinder-85207 Aug 04 05:27:41.548007 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [req-a4f8f03e-5995-4955-92ca-ffce2fd761bd req-ba93688d-40d2-4947-ae8e-8b49ac9334db service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031290 Aug 04 05:27:41.548614 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 155/307] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Aug 4 05:27:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:27:41.611221 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-ef74e5c3-b71d-4887-98da-0c3f7f158c4b tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:27:41.612001 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-ef74e5c3-b71d-4887-98da-0c3f7f158c4b tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] [instance: 48918fad-f7cb-4350-8ecf-e5f803fda4dd] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:27:41.622758 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-ef74e5c3-b71d-4887-98da-0c3f7f158c4b tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:27:41.623327 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-ef74e5c3-b71d-4887-98da-0c3f7f158c4b tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:27:41.624193 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-ef74e5c3-b71d-4887-98da-0c3f7f158c4b tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:27:41.624712 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-ef74e5c3-b71d-4887-98da-0c3f7f158c4b tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:27:41.637646 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [req-92a2baa4-70ce-4f4f-8bee-3ef74940952f req-74cafbf5-4370-4452-8ea3-057f43b2ddc5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8558ff08-5004-4dc4-892d-5b6610ce6bec", "tag": "f7d972aa-2cea-4611-b9c7-a3bf2025197a"}]} {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:27:41.678095 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [req-92a2baa4-70ce-4f4f-8bee-3ef74940952f req-74cafbf5-4370-4452-8ea3-057f43b2ddc5 service nova] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:27:41.679263 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [req-92a2baa4-70ce-4f4f-8bee-3ef74940952f req-74cafbf5-4370-4452-8ea3-057f43b2ddc5 service nova] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:27:41.697661 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.compute.server_external_events [req-92a2baa4-70ce-4f4f-8bee-3ef74940952f req-74cafbf5-4370-4452-8ea3-057f43b2ddc5 service nova] Creating event network-changed:f7d972aa-2cea-4611-b9c7-a3bf2025197a for instance 8558ff08-5004-4dc4-892d-5b6610ce6bec on hv-cinder-85207 Aug 04 05:27:41.706738 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [req-92a2baa4-70ce-4f4f-8bee-3ef74940952f req-74cafbf5-4370-4452-8ea3-057f43b2ddc5 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074722 Aug 04 05:27:41.707521 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 156/308] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Aug 4 05:27:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 05:27:41.709657 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-ef74e5c3-b71d-4887-98da-0c3f7f158c4b tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d384cc766b4ef8bc0498f8fe3e5566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec163b07b5234a48ba80509ac693d8d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:27:41.719564 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-ef74e5c3-b71d-4887-98da-0c3f7f158c4b tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] 10.222.0.46 "GET /compute/v2.1/servers/48918fad-f7cb-4350-8ecf-e5f803fda4dd" status: 200 len: 1461 microversion: 2.1 time: 0.113365 Aug 04 05:27:41.720167 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 153/309] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:27:41 2022] GET /compute/v2.1/servers/48918fad-f7cb-4350-8ecf-e5f803fda4dd => generated 1461 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:27:42.025142 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-2370f7ee-c566-4a98-9fcd-4b2895c0cd93 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:27:42.025884 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-2370f7ee-c566-4a98-9fcd-4b2895c0cd93 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] [instance: 178b675e-f4d0-442c-aa69-aece6ea3d636] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:27:42.032677 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-2370f7ee-c566-4a98-9fcd-4b2895c0cd93 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:27:42.033128 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-2370f7ee-c566-4a98-9fcd-4b2895c0cd93 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:27:42.034172 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-2370f7ee-c566-4a98-9fcd-4b2895c0cd93 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:27:42.034632 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-2370f7ee-c566-4a98-9fcd-4b2895c0cd93 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:27:42.180697 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-2370f7ee-c566-4a98-9fcd-4b2895c0cd93 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8f887f5689419e9e31a0ba43f76ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62d19c831574f9b99c993b5e41c645d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:27:42.188387 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-2370f7ee-c566-4a98-9fcd-4b2895c0cd93 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] 10.222.0.46 "GET /compute/v2.1/servers/178b675e-f4d0-442c-aa69-aece6ea3d636" status: 200 len: 1371 microversion: 2.1 time: 0.168677 Aug 04 05:27:42.188963 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 157/310] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:27:42 2022] GET /compute/v2.1/servers/178b675e-f4d0-442c-aa69-aece6ea3d636 => generated 1371 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:27:42.424523 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-a4cc4184-5e7e-4dac-94a8-83078d254b58 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:27:42.425844 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-a4cc4184-5e7e-4dac-94a8-83078d254b58 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] [instance: 8558ff08-5004-4dc4-892d-5b6610ce6bec] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:27:42.434119 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-a4cc4184-5e7e-4dac-94a8-83078d254b58 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:27:42.434686 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-a4cc4184-5e7e-4dac-94a8-83078d254b58 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:27:42.443982 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-a4cc4184-5e7e-4dac-94a8-83078d254b58 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:27:42.444615 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-a4cc4184-5e7e-4dac-94a8-83078d254b58 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:27:42.627953 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-a4cc4184-5e7e-4dac-94a8-83078d254b58 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965cf2aad5bc4def9fca55aac87cc37e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32569df1dca45cebcdd63d03ff5abae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:27:42.637392 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-a4cc4184-5e7e-4dac-94a8-83078d254b58 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] 10.222.0.46 "GET /compute/v2.1/servers/8558ff08-5004-4dc4-892d-5b6610ce6bec" status: 200 len: 1259 microversion: 2.1 time: 0.217059 Aug 04 05:27:42.637967 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 154/311] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:27:42 2022] GET /compute/v2.1/servers/8558ff08-5004-4dc4-892d-5b6610ce6bec => generated 1259 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:27:42.743777 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-c3316f4e-b066-43fa-b239-d1df621df444 tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:27:42.744456 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-c3316f4e-b066-43fa-b239-d1df621df444 tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] [instance: 48918fad-f7cb-4350-8ecf-e5f803fda4dd] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:27:42.750755 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-c3316f4e-b066-43fa-b239-d1df621df444 tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:27:42.751192 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-c3316f4e-b066-43fa-b239-d1df621df444 tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:27:42.751946 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-c3316f4e-b066-43fa-b239-d1df621df444 tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:27:42.752371 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-c3316f4e-b066-43fa-b239-d1df621df444 tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:27:42.785282 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-c3316f4e-b066-43fa-b239-d1df621df444 tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:27:42.785724 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-c3316f4e-b066-43fa-b239-d1df621df444 tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:27:42.786167 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.objects.instance [None req-c3316f4e-b066-43fa-b239-d1df621df444 tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] Lazy-loading 'fault' on Instance uuid 48918fad-f7cb-4350-8ecf-e5f803fda4dd {{(pid=118477) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 05:27:42.828936 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-c3316f4e-b066-43fa-b239-d1df621df444 tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d384cc766b4ef8bc0498f8fe3e5566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec163b07b5234a48ba80509ac693d8d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:27:42.837594 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-c3316f4e-b066-43fa-b239-d1df621df444 tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] 10.222.0.46 "GET /compute/v2.1/servers/48918fad-f7cb-4350-8ecf-e5f803fda4dd" status: 200 len: 1304 microversion: 2.1 time: 0.098201 Aug 04 05:27:42.838291 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 158/312] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:27:42 2022] GET /compute/v2.1/servers/48918fad-f7cb-4350-8ecf-e5f803fda4dd => generated 1304 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:27:43.210011 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-e68ac2fa-df2c-4cba-ad1d-e8b99556081b tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:27:43.210656 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-e68ac2fa-df2c-4cba-ad1d-e8b99556081b tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] [instance: 178b675e-f4d0-442c-aa69-aece6ea3d636] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:27:43.217871 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-e68ac2fa-df2c-4cba-ad1d-e8b99556081b tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:27:43.218328 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-e68ac2fa-df2c-4cba-ad1d-e8b99556081b tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:27:43.219205 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-e68ac2fa-df2c-4cba-ad1d-e8b99556081b tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:27:43.219648 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-e68ac2fa-df2c-4cba-ad1d-e8b99556081b tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:27:43.364120 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-e68ac2fa-df2c-4cba-ad1d-e8b99556081b tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8f887f5689419e9e31a0ba43f76ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62d19c831574f9b99c993b5e41c645d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:27:43.373473 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-e68ac2fa-df2c-4cba-ad1d-e8b99556081b tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] 10.222.0.46 "GET /compute/v2.1/servers/178b675e-f4d0-442c-aa69-aece6ea3d636" status: 200 len: 1371 microversion: 2.1 time: 0.167315 Aug 04 05:27:43.374130 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 155/313] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:27:43 2022] GET /compute/v2.1/servers/178b675e-f4d0-442c-aa69-aece6ea3d636 => generated 1371 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:27:43.658975 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-e4d5fcc5-a7ee-4e03-874f-35e21c257585 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:27:43.659661 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-e4d5fcc5-a7ee-4e03-874f-35e21c257585 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] [instance: 8558ff08-5004-4dc4-892d-5b6610ce6bec] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:27:43.667652 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-e4d5fcc5-a7ee-4e03-874f-35e21c257585 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:27:43.668098 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-e4d5fcc5-a7ee-4e03-874f-35e21c257585 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:27:43.668904 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-e4d5fcc5-a7ee-4e03-874f-35e21c257585 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:27:43.669336 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-e4d5fcc5-a7ee-4e03-874f-35e21c257585 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:27:43.859927 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-5225552f-1ca6-4dfb-b620-015f12c20d54 tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:27:43.860713 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-5225552f-1ca6-4dfb-b620-015f12c20d54 tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] [instance: 48918fad-f7cb-4350-8ecf-e5f803fda4dd] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:27:43.868741 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-5225552f-1ca6-4dfb-b620-015f12c20d54 tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:27:43.869570 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-5225552f-1ca6-4dfb-b620-015f12c20d54 tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:27:43.870511 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-5225552f-1ca6-4dfb-b620-015f12c20d54 tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:27:43.871172 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-5225552f-1ca6-4dfb-b620-015f12c20d54 tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:27:43.893488 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-e4d5fcc5-a7ee-4e03-874f-35e21c257585 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965cf2aad5bc4def9fca55aac87cc37e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32569df1dca45cebcdd63d03ff5abae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:27:43.902085 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-e4d5fcc5-a7ee-4e03-874f-35e21c257585 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] 10.222.0.46 "GET /compute/v2.1/servers/8558ff08-5004-4dc4-892d-5b6610ce6bec" status: 200 len: 1259 microversion: 2.1 time: 0.247542 Aug 04 05:27:43.903331 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 159/314] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:27:43 2022] GET /compute/v2.1/servers/8558ff08-5004-4dc4-892d-5b6610ce6bec => generated 1259 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:27:43.909104 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-5225552f-1ca6-4dfb-b620-015f12c20d54 tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:27:43.909832 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-5225552f-1ca6-4dfb-b620-015f12c20d54 tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:27:43.910513 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.objects.instance [None req-5225552f-1ca6-4dfb-b620-015f12c20d54 tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] Lazy-loading 'fault' on Instance uuid 48918fad-f7cb-4350-8ecf-e5f803fda4dd {{(pid=118476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 05:27:43.988311 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-5225552f-1ca6-4dfb-b620-015f12c20d54 tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d384cc766b4ef8bc0498f8fe3e5566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec163b07b5234a48ba80509ac693d8d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:27:43.996668 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-5225552f-1ca6-4dfb-b620-015f12c20d54 tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] 10.222.0.46 "GET /compute/v2.1/servers/48918fad-f7cb-4350-8ecf-e5f803fda4dd" status: 200 len: 1304 microversion: 2.1 time: 0.141219 Aug 04 05:27:43.997246 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 156/315] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:27:43 2022] GET /compute/v2.1/servers/48918fad-f7cb-4350-8ecf-e5f803fda4dd => generated 1304 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 05:27:44.399772 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-ba69de7b-f6c2-4c24-954c-90e113b1aff2 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:27:44.400378 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-ba69de7b-f6c2-4c24-954c-90e113b1aff2 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] [instance: 178b675e-f4d0-442c-aa69-aece6ea3d636] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:27:44.406802 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-ba69de7b-f6c2-4c24-954c-90e113b1aff2 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:27:44.407243 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-ba69de7b-f6c2-4c24-954c-90e113b1aff2 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:27:44.408001 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-ba69de7b-f6c2-4c24-954c-90e113b1aff2 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:27:44.408430 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-ba69de7b-f6c2-4c24-954c-90e113b1aff2 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:27:44.544336 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-ba69de7b-f6c2-4c24-954c-90e113b1aff2 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8f887f5689419e9e31a0ba43f76ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62d19c831574f9b99c993b5e41c645d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:27:44.551890 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-ba69de7b-f6c2-4c24-954c-90e113b1aff2 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] 10.222.0.46 "GET /compute/v2.1/servers/178b675e-f4d0-442c-aa69-aece6ea3d636" status: 200 len: 1566 microversion: 2.1 time: 0.156499 Aug 04 05:27:44.552540 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 160/316] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:27:44 2022] GET /compute/v2.1/servers/178b675e-f4d0-442c-aa69-aece6ea3d636 => generated 1566 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:27:44.573779 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-a1cc528c-b4fd-4eeb-9abc-0cdd10b6ce72 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:27:44.574322 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-a1cc528c-b4fd-4eeb-9abc-0cdd10b6ce72 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] [instance: 178b675e-f4d0-442c-aa69-aece6ea3d636] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:27:44.580302 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-a1cc528c-b4fd-4eeb-9abc-0cdd10b6ce72 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:27:44.580780 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-a1cc528c-b4fd-4eeb-9abc-0cdd10b6ce72 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:27:44.581541 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-a1cc528c-b4fd-4eeb-9abc-0cdd10b6ce72 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:27:44.581971 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-a1cc528c-b4fd-4eeb-9abc-0cdd10b6ce72 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:27:44.660850 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-a1cc528c-b4fd-4eeb-9abc-0cdd10b6ce72 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] 10.222.0.46 "GET /compute/v2.1/servers/178b675e-f4d0-442c-aa69-aece6ea3d636/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.091701 Aug 04 05:27:44.661450 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 157/317] 10.222.0.46 () {58 vars in 1275 bytes} [Thu Aug 4 05:27:44 2022] GET /compute/v2.1/servers/178b675e-f4d0-442c-aa69-aece6ea3d636/os-interface => generated 285 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:27:44.923549 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-572f44f9-a0c6-489f-ae12-4800b6d16495 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:27:44.924165 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-572f44f9-a0c6-489f-ae12-4800b6d16495 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] [instance: 8558ff08-5004-4dc4-892d-5b6610ce6bec] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:27:44.931250 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-572f44f9-a0c6-489f-ae12-4800b6d16495 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:27:44.931780 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-572f44f9-a0c6-489f-ae12-4800b6d16495 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:27:44.932670 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-572f44f9-a0c6-489f-ae12-4800b6d16495 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:27:44.933172 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-572f44f9-a0c6-489f-ae12-4800b6d16495 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:27:45.014582 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG dbcounter [-] [118476] Writing DB stats nova_cell0:SELECT=2 {{(pid=118476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:27:45.019774 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-ec9839ce-3a0c-472c-a99f-040230dfe1d2 tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:27:45.020432 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-ec9839ce-3a0c-472c-a99f-040230dfe1d2 tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] [instance: 48918fad-f7cb-4350-8ecf-e5f803fda4dd] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:27:45.029348 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-ec9839ce-3a0c-472c-a99f-040230dfe1d2 tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:27:45.029348 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-ec9839ce-3a0c-472c-a99f-040230dfe1d2 tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:27:45.030498 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-ec9839ce-3a0c-472c-a99f-040230dfe1d2 tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:27:45.030954 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-ec9839ce-3a0c-472c-a99f-040230dfe1d2 tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:27:45.045631 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.wsgi [None req-ec9839ce-3a0c-472c-a99f-040230dfe1d2 tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] HTTP exception thrown: Instance 48918fad-f7cb-4350-8ecf-e5f803fda4dd could not be found. Aug 04 05:27:45.047327 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-ec9839ce-3a0c-472c-a99f-040230dfe1d2 tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] Request method failure captured: Aug 04 05:27:45.047327 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: request: GET /compute/v2.1/servers/48918fad-f7cb-4350-8ecf-e5f803fda4dd HTTP/1.1 Aug 04 05:27:45.047327 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: Accept: application/json Aug 04 05:27:45.047327 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: Accept-Encoding: identity Aug 04 05:27:45.047327 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: Connection: close Aug 04 05:27:45.047327 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: Content-Length: 0 Aug 04 05:27:45.047327 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: Content-Type: application/json Aug 04 05:27:45.047327 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: Host: 10.222.0.46 Aug 04 05:27:45.047327 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: Openstack-System-Scope: None Aug 04 05:27:45.047327 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: User-Agent: python-urllib3/1.26.11 Aug 04 05:27:45.047327 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Auth-Token: gAAAAABi61ixcM8PFJpCisISYbCPWdIhHZFumWWcJrJeNZnMMFPirXIGp4BqPBXV9orV3QS1Qhz_jyJ6Wd8UTmiwbXLtIx2bSUf3Yts6EwJel8JDC-0Sp4x4eI77__shBPv3XKACXZYTrXf2oSBtCeysdgXBIbtI-9eUZE-pmNIoK_KHA-ABof4 Aug 04 05:27:45.047327 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Domain-Id: None Aug 04 05:27:45.047327 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Domain-Name: None Aug 04 05:27:45.047327 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Identity-Status: Confirmed Aug 04 05:27:45.047327 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Is-Admin-Project: True Aug 04 05:27:45.047327 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Project-Domain-Id: default Aug 04 05:27:45.047327 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Project-Domain-Name: Default Aug 04 05:27:45.047327 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Project-Id: ec163b07b5234a48ba80509ac693d8d3 Aug 04 05:27:45.047327 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Project-Name: tempest-VolumesActionsTest-839816448 Aug 04 05:27:45.047327 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Role: member,reader Aug 04 05:27:45.047327 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Roles: member,reader Aug 04 05:27:45.048845 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/ec163b07b5234a48ba80509ac693d8d3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/ec163b07b5234a48ba80509ac693d8d3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_ec163b07b5234a48ba80509ac693d8d3", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/ec163b07b5234a48ba80509ac693d8d3"}]}] Aug 04 05:27:45.048845 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Tenant: tempest-VolumesActionsTest-839816448 Aug 04 05:27:45.048845 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Tenant-Id: ec163b07b5234a48ba80509ac693d8d3 Aug 04 05:27:45.048845 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Tenant-Name: tempest-VolumesActionsTest-839816448 Aug 04 05:27:45.048845 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-User: tempest-VolumesActionsTest-839816448-project Aug 04 05:27:45.048845 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-User-Domain-Id: default Aug 04 05:27:45.048845 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-User-Domain-Name: Default Aug 04 05:27:45.048845 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-User-Id: 02d384cc766b4ef8bc0498f8fe3e5566 Aug 04 05:27:45.048845 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-User-Name: tempest-VolumesActionsTest-839816448-project Aug 04 05:27:45.048845 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: method: > Aug 04 05:27:45.048845 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: exception: Instance 48918fad-f7cb-4350-8ecf-e5f803fda4dd could not be found. Aug 04 05:27:45.048845 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: action_args: {'id': '48918fad-f7cb-4350-8ecf-e5f803fda4dd'} Aug 04 05:27:45.061407 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 05:27:45.061407 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:27:45.061407 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 05:27:45.061407 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 05:27:45.061407 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 05:27:45.061407 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 05:27:45.061407 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 05:27:45.061407 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 05:27:45.061407 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 05:27:45.061407 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 05:27:45.061407 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 48918fad-f7cb-4350-8ecf-e5f803fda4dd could not be found. Aug 04 05:27:45.061407 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Aug 04 05:27:45.061407 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:27:45.061407 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Aug 04 05:27:45.061407 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:27:45.061407 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:27:45.061407 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:27:45.061407 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 05:27:45.061407 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 05:27:45.061407 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 05:27:45.062979 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 05:27:45.062979 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 05:27:45.062979 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 05:27:45.062979 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 05:27:45.062979 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 05:27:45.062979 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 05:27:45.062979 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 05:27:45.062979 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 48918fad-f7cb-4350-8ecf-e5f803fda4dd could not be found. Aug 04 05:27:45.062979 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Aug 04 05:27:45.062979 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:27:45.062979 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Aug 04 05:27:45.062979 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:27:45.062979 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:27:45.062979 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:27:45.062979 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 05:27:45.062979 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 05:27:45.062979 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 48918fad-f7cb-4350-8ecf-e5f803fda4dd could not be found. Aug 04 05:27:45.062979 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Aug 04 05:27:45.064335 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-ec9839ce-3a0c-472c-a99f-040230dfe1d2 tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] Returning 404 to user: Instance 48918fad-f7cb-4350-8ecf-e5f803fda4dd could not be found. {{(pid=118476) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 05:27:45.064335 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-ec9839ce-3a0c-472c-a99f-040230dfe1d2 tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] 10.222.0.46 "GET /compute/v2.1/servers/48918fad-f7cb-4350-8ecf-e5f803fda4dd" status: 404 len: 111 microversion: 2.1 time: 0.035277 Aug 04 05:27:45.064335 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 158/318] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:27:45 2022] GET /compute/v2.1/servers/48918fad-f7cb-4350-8ecf-e5f803fda4dd => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 04 05:27:45.160336 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-321d8878-4e19-410e-8bad-58dd4026affe tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-916249673", "imageRef": "4613f7d0-37ca-46ad-bb26-dc4990dd7d6f", "flavorRef": "452", "networks": [{"uuid": "96aaf21f-7035-4438-86f3-c8dd3a6d3230"}]}} {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:27:45.220619 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.network.neutron [None req-321d8878-4e19-410e-8bad-58dd4026affe tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] validate_networks() for [('96aaf21f-7035-4438-86f3-c8dd3a6d3230', None, None, None, None, None)] {{(pid=118476) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 05:27:45.230024 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-572f44f9-a0c6-489f-ae12-4800b6d16495 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965cf2aad5bc4def9fca55aac87cc37e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32569df1dca45cebcdd63d03ff5abae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:27:45.239071 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-572f44f9-a0c6-489f-ae12-4800b6d16495 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] 10.222.0.46 "GET /compute/v2.1/servers/8558ff08-5004-4dc4-892d-5b6610ce6bec" status: 200 len: 1259 microversion: 2.1 time: 0.319415 Aug 04 05:27:45.239807 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 161/319] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:27:44 2022] GET /compute/v2.1/servers/8558ff08-5004-4dc4-892d-5b6610ce6bec => generated 1259 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:27:45.970817 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.virt.hardware [None req-321d8878-4e19-410e-8bad-58dd4026affe tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] Flavor limits 0:0:0 {{(pid=118476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 05:27:45.971249 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.virt.hardware [None req-321d8878-4e19-410e-8bad-58dd4026affe tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] Image limits 0:0:0 {{(pid=118476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 05:27:45.971711 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.virt.hardware [None req-321d8878-4e19-410e-8bad-58dd4026affe tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] Flavor pref 0:0:0 {{(pid=118476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 05:27:45.972117 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.virt.hardware [None req-321d8878-4e19-410e-8bad-58dd4026affe tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] Image pref 0:0:0 {{(pid=118476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 05:27:45.972527 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.virt.hardware [None req-321d8878-4e19-410e-8bad-58dd4026affe tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 05:27:45.981942 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-321d8878-4e19-410e-8bad-58dd4026affe tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:27:45.982473 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-321d8878-4e19-410e-8bad-58dd4026affe tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:27:45.983271 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-321d8878-4e19-410e-8bad-58dd4026affe tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:27:45.983712 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-321d8878-4e19-410e-8bad-58dd4026affe tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:27:46.000568 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.quota [None req-321d8878-4e19-410e-8bad-58dd4026affe tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] Getting quotas for project ec163b07b5234a48ba80509ac693d8d3. Resources: {'instances', 'cores', 'ram'} {{(pid=118476) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 05:27:46.004992 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.quota [None req-321d8878-4e19-410e-8bad-58dd4026affe tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] Getting quotas for user 02d384cc766b4ef8bc0498f8fe3e5566 and project ec163b07b5234a48ba80509ac693d8d3. Resources: {'instances', 'cores', 'ram'} {{(pid=118476) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 05:27:46.017767 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-321d8878-4e19-410e-8bad-58dd4026affe tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] Going to run 1 instances... {{(pid=118476) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 05:27:46.019977 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-321d8878-4e19-410e-8bad-58dd4026affe tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] [instance: f7a58682-ab3a-45da-9529-56edbbaad8c9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4613f7d0-37ca-46ad-bb26-dc4990dd7d6f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118476) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 05:27:46.042386 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG dbcounter [-] [118476] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=5 {{(pid=118476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:27:46.137558 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-321d8878-4e19-410e-8bad-58dd4026affe tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.981814 Aug 04 05:27:46.138340 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 159/320] 10.222.0.46 () {60 vars in 1147 bytes} [Thu Aug 4 05:27:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 983 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 04 05:27:46.153319 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-cbb2ab73-11a5-43a7-9bc9-52bf018a144f tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:27:46.164228 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-cbb2ab73-11a5-43a7-9bc9-52bf018a144f tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] [instance: f7a58682-ab3a-45da-9529-56edbbaad8c9] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:27:46.173698 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG dbcounter [-] [118477] Writing DB stats nova_cell0:SELECT=26 {{(pid=118477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:27:46.261606 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-6a6886b7-41fb-45c4-8952-541b43c10b8f tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:27:46.262825 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-6a6886b7-41fb-45c4-8952-541b43c10b8f tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] [instance: 8558ff08-5004-4dc4-892d-5b6610ce6bec] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:27:46.273841 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-cbb2ab73-11a5-43a7-9bc9-52bf018a144f tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d384cc766b4ef8bc0498f8fe3e5566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec163b07b5234a48ba80509ac693d8d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:27:46.278548 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-6a6886b7-41fb-45c4-8952-541b43c10b8f tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:27:46.279211 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-6a6886b7-41fb-45c4-8952-541b43c10b8f tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:27:46.281617 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-cbb2ab73-11a5-43a7-9bc9-52bf018a144f tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] 10.222.0.46 "GET /compute/v2.1/servers/f7a58682-ab3a-45da-9529-56edbbaad8c9" status: 200 len: 1213 microversion: 2.1 time: 0.135201 Aug 04 05:27:46.282970 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-6a6886b7-41fb-45c4-8952-541b43c10b8f tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:27:46.283864 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-6a6886b7-41fb-45c4-8952-541b43c10b8f tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:27:46.295839 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 162/321] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:27:46 2022] GET /compute/v2.1/servers/f7a58682-ab3a-45da-9529-56edbbaad8c9 => generated 1213 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:27:46.793385 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-6a6886b7-41fb-45c4-8952-541b43c10b8f tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965cf2aad5bc4def9fca55aac87cc37e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32569df1dca45cebcdd63d03ff5abae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:27:46.808853 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [req-b1cb3593-2800-4c2e-8657-ad0998559288 req-b5d89ca9-e594-44ad-a29e-04ff60e3e6c0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "178b675e-f4d0-442c-aa69-aece6ea3d636", "tag": "ea55da7a-e1dc-47c4-9f10-3c184df3b802"}]} {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:27:46.818383 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-6a6886b7-41fb-45c4-8952-541b43c10b8f tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] 10.222.0.46 "GET /compute/v2.1/servers/8558ff08-5004-4dc4-892d-5b6610ce6bec" status: 200 len: 1259 microversion: 2.1 time: 0.556135 Aug 04 05:27:46.818383 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 160/322] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:27:46 2022] GET /compute/v2.1/servers/8558ff08-5004-4dc4-892d-5b6610ce6bec => generated 1259 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:27:46.819665 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [req-b1cb3593-2800-4c2e-8657-ad0998559288 req-b5d89ca9-e594-44ad-a29e-04ff60e3e6c0 service nova] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:27:46.820431 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [req-b1cb3593-2800-4c2e-8657-ad0998559288 req-b5d89ca9-e594-44ad-a29e-04ff60e3e6c0 service nova] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:27:46.832299 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.compute.server_external_events [req-b1cb3593-2800-4c2e-8657-ad0998559288 req-b5d89ca9-e594-44ad-a29e-04ff60e3e6c0 service nova] Creating event network-changed:ea55da7a-e1dc-47c4-9f10-3c184df3b802 for instance 178b675e-f4d0-442c-aa69-aece6ea3d636 on hv-cinder-85207 Aug 04 05:27:46.837523 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [req-b1cb3593-2800-4c2e-8657-ad0998559288 req-b5d89ca9-e594-44ad-a29e-04ff60e3e6c0 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033792 Aug 04 05:27:46.838126 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 163/323] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Aug 4 05:27:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:27:47.308988 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-d866044e-0335-4cc6-8844-d0037f8fbc34 tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:27:47.310171 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-d866044e-0335-4cc6-8844-d0037f8fbc34 tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] [instance: f7a58682-ab3a-45da-9529-56edbbaad8c9] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:27:47.325056 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-d866044e-0335-4cc6-8844-d0037f8fbc34 tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:27:47.326510 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-d866044e-0335-4cc6-8844-d0037f8fbc34 tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:27:47.328034 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-d866044e-0335-4cc6-8844-d0037f8fbc34 tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:27:47.328823 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-d866044e-0335-4cc6-8844-d0037f8fbc34 tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:27:47.443162 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-d866044e-0335-4cc6-8844-d0037f8fbc34 tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d384cc766b4ef8bc0498f8fe3e5566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec163b07b5234a48ba80509ac693d8d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:27:47.451824 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-d866044e-0335-4cc6-8844-d0037f8fbc34 tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] 10.222.0.46 "GET /compute/v2.1/servers/f7a58682-ab3a-45da-9529-56edbbaad8c9" status: 200 len: 1217 microversion: 2.1 time: 0.150812 Aug 04 05:27:47.452573 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 161/324] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:27:47 2022] GET /compute/v2.1/servers/f7a58682-ab3a-45da-9529-56edbbaad8c9 => generated 1217 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:27:47.842161 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-8c740a5b-86bd-4b79-8058-1e9bee10f44e tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:27:47.842915 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-8c740a5b-86bd-4b79-8058-1e9bee10f44e tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] [instance: 8558ff08-5004-4dc4-892d-5b6610ce6bec] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:27:47.849739 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-8c740a5b-86bd-4b79-8058-1e9bee10f44e tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:27:47.850177 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-8c740a5b-86bd-4b79-8058-1e9bee10f44e tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:27:47.851037 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-8c740a5b-86bd-4b79-8058-1e9bee10f44e tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:27:47.851477 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-8c740a5b-86bd-4b79-8058-1e9bee10f44e tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:27:48.015635 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-8c740a5b-86bd-4b79-8058-1e9bee10f44e tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965cf2aad5bc4def9fca55aac87cc37e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32569df1dca45cebcdd63d03ff5abae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:27:48.037164 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-8c740a5b-86bd-4b79-8058-1e9bee10f44e tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] 10.222.0.46 "GET /compute/v2.1/servers/8558ff08-5004-4dc4-892d-5b6610ce6bec" status: 200 len: 1259 microversion: 2.1 time: 0.191795 Aug 04 05:27:48.037164 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 164/325] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:27:47 2022] GET /compute/v2.1/servers/8558ff08-5004-4dc4-892d-5b6610ce6bec => generated 1259 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:27:48.473126 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-09381914-3544-4848-8978-aafdd517f9bc tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:27:48.473759 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-09381914-3544-4848-8978-aafdd517f9bc tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] [instance: f7a58682-ab3a-45da-9529-56edbbaad8c9] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:27:48.481311 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-09381914-3544-4848-8978-aafdd517f9bc tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:27:48.481756 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-09381914-3544-4848-8978-aafdd517f9bc tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:27:48.482558 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-09381914-3544-4848-8978-aafdd517f9bc tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:27:48.482996 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-09381914-3544-4848-8978-aafdd517f9bc tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:27:48.561609 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-09381914-3544-4848-8978-aafdd517f9bc tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d384cc766b4ef8bc0498f8fe3e5566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec163b07b5234a48ba80509ac693d8d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:27:48.569367 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-09381914-3544-4848-8978-aafdd517f9bc tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] 10.222.0.46 "GET /compute/v2.1/servers/f7a58682-ab3a-45da-9529-56edbbaad8c9" status: 200 len: 1265 microversion: 2.1 time: 0.100194 Aug 04 05:27:48.570854 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 162/326] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:27:48 2022] GET /compute/v2.1/servers/f7a58682-ab3a-45da-9529-56edbbaad8c9 => generated 1265 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:27:49.049696 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-cf0cc2ea-d221-43c6-9736-fda836430ccc tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:27:49.050318 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-cf0cc2ea-d221-43c6-9736-fda836430ccc tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] [instance: 8558ff08-5004-4dc4-892d-5b6610ce6bec] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:27:49.057429 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-cf0cc2ea-d221-43c6-9736-fda836430ccc tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:27:49.057873 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-cf0cc2ea-d221-43c6-9736-fda836430ccc tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:27:49.058690 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-cf0cc2ea-d221-43c6-9736-fda836430ccc tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:27:49.059266 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-cf0cc2ea-d221-43c6-9736-fda836430ccc tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:27:49.286070 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-cf0cc2ea-d221-43c6-9736-fda836430ccc tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965cf2aad5bc4def9fca55aac87cc37e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32569df1dca45cebcdd63d03ff5abae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:27:49.293906 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-cf0cc2ea-d221-43c6-9736-fda836430ccc tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] 10.222.0.46 "GET /compute/v2.1/servers/8558ff08-5004-4dc4-892d-5b6610ce6bec" status: 200 len: 1259 microversion: 2.1 time: 0.248122 Aug 04 05:27:49.294613 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 165/327] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:27:49 2022] GET /compute/v2.1/servers/8558ff08-5004-4dc4-892d-5b6610ce6bec => generated 1259 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:27:49.590947 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-d45495b1-f7ed-494b-b4ad-01bf86836e03 tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:27:49.591536 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-d45495b1-f7ed-494b-b4ad-01bf86836e03 tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] [instance: f7a58682-ab3a-45da-9529-56edbbaad8c9] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:27:49.598034 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-d45495b1-f7ed-494b-b4ad-01bf86836e03 tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:27:49.598512 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-d45495b1-f7ed-494b-b4ad-01bf86836e03 tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:27:49.599267 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-d45495b1-f7ed-494b-b4ad-01bf86836e03 tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:27:49.599698 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-d45495b1-f7ed-494b-b4ad-01bf86836e03 tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:27:49.733658 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-d45495b1-f7ed-494b-b4ad-01bf86836e03 tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d384cc766b4ef8bc0498f8fe3e5566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec163b07b5234a48ba80509ac693d8d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:27:49.741073 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-d45495b1-f7ed-494b-b4ad-01bf86836e03 tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] 10.222.0.46 "GET /compute/v2.1/servers/f7a58682-ab3a-45da-9529-56edbbaad8c9" status: 200 len: 1313 microversion: 2.1 time: 0.153960 Aug 04 05:27:49.741635 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 163/328] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:27:49 2022] GET /compute/v2.1/servers/f7a58682-ab3a-45da-9529-56edbbaad8c9 => generated 1313 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:27:50.314668 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-559f7e32-3667-4188-b221-7c66df92b104 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:27:50.315216 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-559f7e32-3667-4188-b221-7c66df92b104 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] [instance: 8558ff08-5004-4dc4-892d-5b6610ce6bec] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:27:50.322144 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-559f7e32-3667-4188-b221-7c66df92b104 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:27:50.322621 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-559f7e32-3667-4188-b221-7c66df92b104 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:27:50.323393 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-559f7e32-3667-4188-b221-7c66df92b104 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:27:50.323829 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-559f7e32-3667-4188-b221-7c66df92b104 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:27:50.461742 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-559f7e32-3667-4188-b221-7c66df92b104 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965cf2aad5bc4def9fca55aac87cc37e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32569df1dca45cebcdd63d03ff5abae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:27:50.469899 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-559f7e32-3667-4188-b221-7c66df92b104 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] 10.222.0.46 "GET /compute/v2.1/servers/8558ff08-5004-4dc4-892d-5b6610ce6bec" status: 200 len: 1259 microversion: 2.1 time: 0.158782 Aug 04 05:27:50.470661 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 166/329] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:27:50 2022] GET /compute/v2.1/servers/8558ff08-5004-4dc4-892d-5b6610ce6bec => generated 1259 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 05:27:50.763000 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-3ef715c8-0ed8-46b4-af19-ace66623588f tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:27:50.763597 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-3ef715c8-0ed8-46b4-af19-ace66623588f tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] [instance: f7a58682-ab3a-45da-9529-56edbbaad8c9] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:27:50.770414 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-3ef715c8-0ed8-46b4-af19-ace66623588f tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:27:50.771043 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-3ef715c8-0ed8-46b4-af19-ace66623588f tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:27:50.771829 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-3ef715c8-0ed8-46b4-af19-ace66623588f tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:27:50.772258 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-3ef715c8-0ed8-46b4-af19-ace66623588f tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:27:50.910733 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-3ef715c8-0ed8-46b4-af19-ace66623588f tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d384cc766b4ef8bc0498f8fe3e5566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec163b07b5234a48ba80509ac693d8d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:27:50.918666 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-3ef715c8-0ed8-46b4-af19-ace66623588f tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] 10.222.0.46 "GET /compute/v2.1/servers/f7a58682-ab3a-45da-9529-56edbbaad8c9" status: 200 len: 1313 microversion: 2.1 time: 0.159425 Aug 04 05:27:50.919277 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 164/330] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:27:50 2022] GET /compute/v2.1/servers/f7a58682-ab3a-45da-9529-56edbbaad8c9 => generated 1313 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 05:27:51.491162 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-9d4f52aa-2104-4a98-8492-9ec326fe1c09 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:27:51.491775 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-9d4f52aa-2104-4a98-8492-9ec326fe1c09 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] [instance: 8558ff08-5004-4dc4-892d-5b6610ce6bec] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:27:51.499167 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-9d4f52aa-2104-4a98-8492-9ec326fe1c09 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:27:51.499612 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-9d4f52aa-2104-4a98-8492-9ec326fe1c09 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:27:51.500383 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-9d4f52aa-2104-4a98-8492-9ec326fe1c09 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:27:51.500821 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-9d4f52aa-2104-4a98-8492-9ec326fe1c09 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:27:51.654387 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-9d4f52aa-2104-4a98-8492-9ec326fe1c09 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965cf2aad5bc4def9fca55aac87cc37e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32569df1dca45cebcdd63d03ff5abae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:27:51.662810 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-9d4f52aa-2104-4a98-8492-9ec326fe1c09 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] 10.222.0.46 "GET /compute/v2.1/servers/8558ff08-5004-4dc4-892d-5b6610ce6bec" status: 200 len: 1259 microversion: 2.1 time: 0.175426 Aug 04 05:27:51.663390 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 167/331] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:27:51 2022] GET /compute/v2.1/servers/8558ff08-5004-4dc4-892d-5b6610ce6bec => generated 1259 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:27:51.939923 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-190f7596-fe5e-4361-b245-f3970046ae24 tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:27:51.940520 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-190f7596-fe5e-4361-b245-f3970046ae24 tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] [instance: f7a58682-ab3a-45da-9529-56edbbaad8c9] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:27:51.948534 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-190f7596-fe5e-4361-b245-f3970046ae24 tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:27:51.948974 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-190f7596-fe5e-4361-b245-f3970046ae24 tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:27:51.949759 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-190f7596-fe5e-4361-b245-f3970046ae24 tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:27:51.950185 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-190f7596-fe5e-4361-b245-f3970046ae24 tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:27:52.165375 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-190f7596-fe5e-4361-b245-f3970046ae24 tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d384cc766b4ef8bc0498f8fe3e5566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec163b07b5234a48ba80509ac693d8d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:27:52.171035 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG dbcounter [-] [118476] Writing DB stats nova_cell1:SELECT=100 {{(pid=118476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:27:52.175272 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-190f7596-fe5e-4361-b245-f3970046ae24 tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] 10.222.0.46 "GET /compute/v2.1/servers/f7a58682-ab3a-45da-9529-56edbbaad8c9" status: 200 len: 1313 microversion: 2.1 time: 0.239091 Aug 04 05:27:52.175866 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 165/332] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:27:51 2022] GET /compute/v2.1/servers/f7a58682-ab3a-45da-9529-56edbbaad8c9 => generated 1313 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:27:52.685293 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-58bbda30-fa6e-4527-97c8-622f28e37018 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:27:52.685848 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-58bbda30-fa6e-4527-97c8-622f28e37018 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] [instance: 8558ff08-5004-4dc4-892d-5b6610ce6bec] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:27:52.692501 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-58bbda30-fa6e-4527-97c8-622f28e37018 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:27:52.693164 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-58bbda30-fa6e-4527-97c8-622f28e37018 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:27:52.693900 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-58bbda30-fa6e-4527-97c8-622f28e37018 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:27:52.694358 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-58bbda30-fa6e-4527-97c8-622f28e37018 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:27:52.700124 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG dbcounter [-] [118477] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:27:52.815542 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [req-78aca143-74ec-4862-a84e-9fc8f4f2e0cc req-0e5a89b6-d6ba-4125-8174-0552fe52d88e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f7a58682-ab3a-45da-9529-56edbbaad8c9", "tag": "9b046414-ec4f-452f-9f7a-a37617fdce1a"}]} {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:27:52.828018 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [req-78aca143-74ec-4862-a84e-9fc8f4f2e0cc req-0e5a89b6-d6ba-4125-8174-0552fe52d88e service nova] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:27:52.828568 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [req-78aca143-74ec-4862-a84e-9fc8f4f2e0cc req-0e5a89b6-d6ba-4125-8174-0552fe52d88e service nova] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:27:52.840613 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.compute.server_external_events [req-78aca143-74ec-4862-a84e-9fc8f4f2e0cc req-0e5a89b6-d6ba-4125-8174-0552fe52d88e service nova] Creating event network-changed:9b046414-ec4f-452f-9f7a-a37617fdce1a for instance f7a58682-ab3a-45da-9529-56edbbaad8c9 on hv-cinder-85207 Aug 04 05:27:52.848537 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [req-78aca143-74ec-4862-a84e-9fc8f4f2e0cc req-0e5a89b6-d6ba-4125-8174-0552fe52d88e service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037401 Aug 04 05:27:52.849238 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 166/333] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Aug 4 05:27:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 05:27:52.893365 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-58bbda30-fa6e-4527-97c8-622f28e37018 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965cf2aad5bc4def9fca55aac87cc37e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32569df1dca45cebcdd63d03ff5abae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:27:52.902327 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-58bbda30-fa6e-4527-97c8-622f28e37018 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] 10.222.0.46 "GET /compute/v2.1/servers/8558ff08-5004-4dc4-892d-5b6610ce6bec" status: 200 len: 1259 microversion: 2.1 time: 0.221598 Aug 04 05:27:52.910429 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 168/334] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:27:52 2022] GET /compute/v2.1/servers/8558ff08-5004-4dc4-892d-5b6610ce6bec => generated 1259 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:27:53.198183 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-8612602a-fa5d-449e-b3f9-d730af2a927c tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:27:53.198914 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-8612602a-fa5d-449e-b3f9-d730af2a927c tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] [instance: f7a58682-ab3a-45da-9529-56edbbaad8c9] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:27:53.205202 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-8612602a-fa5d-449e-b3f9-d730af2a927c tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:27:53.205663 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-8612602a-fa5d-449e-b3f9-d730af2a927c tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:27:53.206466 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-8612602a-fa5d-449e-b3f9-d730af2a927c tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:27:53.206905 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-8612602a-fa5d-449e-b3f9-d730af2a927c tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:27:53.429156 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-8612602a-fa5d-449e-b3f9-d730af2a927c tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d384cc766b4ef8bc0498f8fe3e5566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec163b07b5234a48ba80509ac693d8d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:27:53.436724 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-8612602a-fa5d-449e-b3f9-d730af2a927c tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] 10.222.0.46 "GET /compute/v2.1/servers/f7a58682-ab3a-45da-9529-56edbbaad8c9" status: 200 len: 1313 microversion: 2.1 time: 0.243269 Aug 04 05:27:53.437302 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 167/335] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:27:53 2022] GET /compute/v2.1/servers/f7a58682-ab3a-45da-9529-56edbbaad8c9 => generated 1313 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:27:53.924290 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-4dfbb09f-61a8-4f32-a25d-6f743fa33fa6 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:27:53.924901 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-4dfbb09f-61a8-4f32-a25d-6f743fa33fa6 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] [instance: 8558ff08-5004-4dc4-892d-5b6610ce6bec] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:27:53.932475 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-4dfbb09f-61a8-4f32-a25d-6f743fa33fa6 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:27:53.934727 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-4dfbb09f-61a8-4f32-a25d-6f743fa33fa6 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:27:53.934727 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-4dfbb09f-61a8-4f32-a25d-6f743fa33fa6 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:27:53.934727 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-4dfbb09f-61a8-4f32-a25d-6f743fa33fa6 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:27:54.076818 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-4dfbb09f-61a8-4f32-a25d-6f743fa33fa6 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965cf2aad5bc4def9fca55aac87cc37e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32569df1dca45cebcdd63d03ff5abae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:27:54.084402 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-4dfbb09f-61a8-4f32-a25d-6f743fa33fa6 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] 10.222.0.46 "GET /compute/v2.1/servers/8558ff08-5004-4dc4-892d-5b6610ce6bec" status: 200 len: 1259 microversion: 2.1 time: 0.164202 Aug 04 05:27:54.084962 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 169/336] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:27:53 2022] GET /compute/v2.1/servers/8558ff08-5004-4dc4-892d-5b6610ce6bec => generated 1259 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:27:54.458008 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-5fda9bdc-bc97-4b71-b5af-76c1b9bd019a tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:27:54.458561 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-5fda9bdc-bc97-4b71-b5af-76c1b9bd019a tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] [instance: f7a58682-ab3a-45da-9529-56edbbaad8c9] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:27:54.465012 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-5fda9bdc-bc97-4b71-b5af-76c1b9bd019a tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:27:54.465452 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-5fda9bdc-bc97-4b71-b5af-76c1b9bd019a tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:27:54.466208 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-5fda9bdc-bc97-4b71-b5af-76c1b9bd019a tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:27:54.466664 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-5fda9bdc-bc97-4b71-b5af-76c1b9bd019a tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:27:54.593957 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-5fda9bdc-bc97-4b71-b5af-76c1b9bd019a tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d384cc766b4ef8bc0498f8fe3e5566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec163b07b5234a48ba80509ac693d8d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:27:54.602404 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-5fda9bdc-bc97-4b71-b5af-76c1b9bd019a tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] 10.222.0.46 "GET /compute/v2.1/servers/f7a58682-ab3a-45da-9529-56edbbaad8c9" status: 200 len: 1313 microversion: 2.1 time: 0.147624 Aug 04 05:27:54.603198 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 168/337] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:27:54 2022] GET /compute/v2.1/servers/f7a58682-ab3a-45da-9529-56edbbaad8c9 => generated 1313 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:27:55.106359 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-a34cd0e8-656d-4e1a-acb3-d2fa068f0d5a tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:27:55.109691 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-a34cd0e8-656d-4e1a-acb3-d2fa068f0d5a tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] [instance: 8558ff08-5004-4dc4-892d-5b6610ce6bec] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:27:55.112900 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-a34cd0e8-656d-4e1a-acb3-d2fa068f0d5a tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:27:55.113338 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-a34cd0e8-656d-4e1a-acb3-d2fa068f0d5a tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:27:55.114189 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-a34cd0e8-656d-4e1a-acb3-d2fa068f0d5a tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:27:55.114714 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-a34cd0e8-656d-4e1a-acb3-d2fa068f0d5a tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:27:55.247275 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-a34cd0e8-656d-4e1a-acb3-d2fa068f0d5a tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965cf2aad5bc4def9fca55aac87cc37e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32569df1dca45cebcdd63d03ff5abae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:27:55.254788 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-a34cd0e8-656d-4e1a-acb3-d2fa068f0d5a tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] 10.222.0.46 "GET /compute/v2.1/servers/8558ff08-5004-4dc4-892d-5b6610ce6bec" status: 200 len: 1259 microversion: 2.1 time: 0.153122 Aug 04 05:27:55.255345 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 170/338] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:27:55 2022] GET /compute/v2.1/servers/8558ff08-5004-4dc4-892d-5b6610ce6bec => generated 1259 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:27:55.623938 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-9dc568cc-18d1-498e-be7f-8da09ce65b88 tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:27:55.624546 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-9dc568cc-18d1-498e-be7f-8da09ce65b88 tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] [instance: f7a58682-ab3a-45da-9529-56edbbaad8c9] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:27:55.631179 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-9dc568cc-18d1-498e-be7f-8da09ce65b88 tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:27:55.631627 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-9dc568cc-18d1-498e-be7f-8da09ce65b88 tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:27:55.632384 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-9dc568cc-18d1-498e-be7f-8da09ce65b88 tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:27:55.633496 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-9dc568cc-18d1-498e-be7f-8da09ce65b88 tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:27:55.771007 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-9dc568cc-18d1-498e-be7f-8da09ce65b88 tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d384cc766b4ef8bc0498f8fe3e5566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec163b07b5234a48ba80509ac693d8d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:27:55.779049 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-9dc568cc-18d1-498e-be7f-8da09ce65b88 tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] 10.222.0.46 "GET /compute/v2.1/servers/f7a58682-ab3a-45da-9529-56edbbaad8c9" status: 200 len: 1313 microversion: 2.1 time: 0.159050 Aug 04 05:27:55.779625 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 169/339] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:27:55 2022] GET /compute/v2.1/servers/f7a58682-ab3a-45da-9529-56edbbaad8c9 => generated 1313 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:27:56.277064 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-77573805-0a2d-41e5-b66f-17a1540cfe37 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:27:56.277683 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-77573805-0a2d-41e5-b66f-17a1540cfe37 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] [instance: 8558ff08-5004-4dc4-892d-5b6610ce6bec] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:27:56.280271 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG dbcounter [-] [118477] Writing DB stats nova_cell0:SELECT=2 {{(pid=118477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:27:56.286387 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-77573805-0a2d-41e5-b66f-17a1540cfe37 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:27:56.286835 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-77573805-0a2d-41e5-b66f-17a1540cfe37 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:27:56.287590 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-77573805-0a2d-41e5-b66f-17a1540cfe37 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:27:56.288011 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-77573805-0a2d-41e5-b66f-17a1540cfe37 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:27:56.424935 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-77573805-0a2d-41e5-b66f-17a1540cfe37 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965cf2aad5bc4def9fca55aac87cc37e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32569df1dca45cebcdd63d03ff5abae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:27:56.438199 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-77573805-0a2d-41e5-b66f-17a1540cfe37 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] 10.222.0.46 "GET /compute/v2.1/servers/8558ff08-5004-4dc4-892d-5b6610ce6bec" status: 200 len: 1259 microversion: 2.1 time: 0.165887 Aug 04 05:27:56.450338 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 171/340] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:27:56 2022] GET /compute/v2.1/servers/8558ff08-5004-4dc4-892d-5b6610ce6bec => generated 1259 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:27:56.801836 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-68eb3dd6-2ef3-4180-b7a9-8d0e61c7f5e9 tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:27:56.802543 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-68eb3dd6-2ef3-4180-b7a9-8d0e61c7f5e9 tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] [instance: f7a58682-ab3a-45da-9529-56edbbaad8c9] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:27:56.808254 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG dbcounter [-] [118476] Writing DB stats nova_cell0:SELECT=2 {{(pid=118476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:27:56.808784 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG dbcounter [-] [118476] Writing DB stats nova_cell0:SELECT=16 {{(pid=118476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:27:56.811055 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-68eb3dd6-2ef3-4180-b7a9-8d0e61c7f5e9 tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:27:56.811501 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-68eb3dd6-2ef3-4180-b7a9-8d0e61c7f5e9 tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:27:56.812261 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-68eb3dd6-2ef3-4180-b7a9-8d0e61c7f5e9 tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:27:56.812864 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-68eb3dd6-2ef3-4180-b7a9-8d0e61c7f5e9 tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:27:56.951484 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-68eb3dd6-2ef3-4180-b7a9-8d0e61c7f5e9 tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d384cc766b4ef8bc0498f8fe3e5566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec163b07b5234a48ba80509ac693d8d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:27:56.959035 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-68eb3dd6-2ef3-4180-b7a9-8d0e61c7f5e9 tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] 10.222.0.46 "GET /compute/v2.1/servers/f7a58682-ab3a-45da-9529-56edbbaad8c9" status: 200 len: 1313 microversion: 2.1 time: 0.161836 Aug 04 05:27:56.959599 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 170/341] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:27:56 2022] GET /compute/v2.1/servers/f7a58682-ab3a-45da-9529-56edbbaad8c9 => generated 1313 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:27:57.461881 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-1332e83e-50c7-4f34-9a79-dfd7b53a481f tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:27:57.462572 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-1332e83e-50c7-4f34-9a79-dfd7b53a481f tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] [instance: 8558ff08-5004-4dc4-892d-5b6610ce6bec] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:27:57.469379 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-1332e83e-50c7-4f34-9a79-dfd7b53a481f tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:27:57.469825 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-1332e83e-50c7-4f34-9a79-dfd7b53a481f tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:27:57.470621 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-1332e83e-50c7-4f34-9a79-dfd7b53a481f tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:27:57.471047 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-1332e83e-50c7-4f34-9a79-dfd7b53a481f tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:27:57.607620 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-1332e83e-50c7-4f34-9a79-dfd7b53a481f tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965cf2aad5bc4def9fca55aac87cc37e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32569df1dca45cebcdd63d03ff5abae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:27:57.615297 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-1332e83e-50c7-4f34-9a79-dfd7b53a481f tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] 10.222.0.46 "GET /compute/v2.1/servers/8558ff08-5004-4dc4-892d-5b6610ce6bec" status: 200 len: 1259 microversion: 2.1 time: 0.158040 Aug 04 05:27:57.615876 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 172/342] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:27:57 2022] GET /compute/v2.1/servers/8558ff08-5004-4dc4-892d-5b6610ce6bec => generated 1259 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:27:57.981257 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-fdd78cd7-d530-488e-9a07-dd506532883f tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:27:57.981926 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-fdd78cd7-d530-488e-9a07-dd506532883f tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] [instance: f7a58682-ab3a-45da-9529-56edbbaad8c9] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:27:57.989796 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-fdd78cd7-d530-488e-9a07-dd506532883f tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:27:57.990344 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-fdd78cd7-d530-488e-9a07-dd506532883f tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:27:57.991102 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-fdd78cd7-d530-488e-9a07-dd506532883f tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:27:57.991538 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-fdd78cd7-d530-488e-9a07-dd506532883f tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:27:58.131288 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-fdd78cd7-d530-488e-9a07-dd506532883f tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d384cc766b4ef8bc0498f8fe3e5566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec163b07b5234a48ba80509ac693d8d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:27:58.152598 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-fdd78cd7-d530-488e-9a07-dd506532883f tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] 10.222.0.46 "GET /compute/v2.1/servers/f7a58682-ab3a-45da-9529-56edbbaad8c9" status: 200 len: 1313 microversion: 2.1 time: 0.175956 Aug 04 05:27:58.153191 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 171/343] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:27:57 2022] GET /compute/v2.1/servers/f7a58682-ab3a-45da-9529-56edbbaad8c9 => generated 1313 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:27:58.427030 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [req-372b84fd-f3e0-48e3-bdeb-7eacb548dcb3 req-32ae50db-9a61-414b-98e5-b31cacb33711 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8558ff08-5004-4dc4-892d-5b6610ce6bec", "name": "network-vif-plugged", "status": "completed", "tag": "f7d972aa-2cea-4611-b9c7-a3bf2025197a"}]} {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:27:58.436937 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [req-372b84fd-f3e0-48e3-bdeb-7eacb548dcb3 req-32ae50db-9a61-414b-98e5-b31cacb33711 service nova] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:27:58.437378 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [req-372b84fd-f3e0-48e3-bdeb-7eacb548dcb3 req-32ae50db-9a61-414b-98e5-b31cacb33711 service nova] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:27:58.448902 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.compute.server_external_events [req-372b84fd-f3e0-48e3-bdeb-7eacb548dcb3 req-32ae50db-9a61-414b-98e5-b31cacb33711 service nova] Creating event network-vif-plugged:f7d972aa-2cea-4611-b9c7-a3bf2025197a for instance 8558ff08-5004-4dc4-892d-5b6610ce6bec on hv-cinder-85207 Aug 04 05:27:58.453717 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [req-372b84fd-f3e0-48e3-bdeb-7eacb548dcb3 req-32ae50db-9a61-414b-98e5-b31cacb33711 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030433 Aug 04 05:27:58.454334 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 173/344] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Aug 4 05:27:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:27:58.636656 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-e8f0bbef-2ee6-4073-86a7-fbc33c0424da tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:27:58.637426 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-e8f0bbef-2ee6-4073-86a7-fbc33c0424da tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] [instance: 8558ff08-5004-4dc4-892d-5b6610ce6bec] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:27:58.643628 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-e8f0bbef-2ee6-4073-86a7-fbc33c0424da tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:27:58.644107 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-e8f0bbef-2ee6-4073-86a7-fbc33c0424da tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:27:58.644942 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-e8f0bbef-2ee6-4073-86a7-fbc33c0424da tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:27:58.645371 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-e8f0bbef-2ee6-4073-86a7-fbc33c0424da tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:27:58.781107 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-e8f0bbef-2ee6-4073-86a7-fbc33c0424da tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965cf2aad5bc4def9fca55aac87cc37e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32569df1dca45cebcdd63d03ff5abae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:27:58.788995 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-e8f0bbef-2ee6-4073-86a7-fbc33c0424da tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] 10.222.0.46 "GET /compute/v2.1/servers/8558ff08-5004-4dc4-892d-5b6610ce6bec" status: 200 len: 1259 microversion: 2.1 time: 0.156326 Aug 04 05:27:58.789735 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 172/345] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:27:58 2022] GET /compute/v2.1/servers/8558ff08-5004-4dc4-892d-5b6610ce6bec => generated 1259 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:27:59.177333 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-8466db09-803b-4625-a566-3e7666fd809e tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:27:59.178037 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-8466db09-803b-4625-a566-3e7666fd809e tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] [instance: f7a58682-ab3a-45da-9529-56edbbaad8c9] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:27:59.185299 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-8466db09-803b-4625-a566-3e7666fd809e tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:27:59.185747 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-8466db09-803b-4625-a566-3e7666fd809e tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:27:59.186679 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-8466db09-803b-4625-a566-3e7666fd809e tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:27:59.187118 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-8466db09-803b-4625-a566-3e7666fd809e tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:27:59.325879 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-8466db09-803b-4625-a566-3e7666fd809e tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d384cc766b4ef8bc0498f8fe3e5566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec163b07b5234a48ba80509ac693d8d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:27:59.333261 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-8466db09-803b-4625-a566-3e7666fd809e tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] 10.222.0.46 "GET /compute/v2.1/servers/f7a58682-ab3a-45da-9529-56edbbaad8c9" status: 200 len: 1313 microversion: 2.1 time: 0.161432 Aug 04 05:27:59.333823 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 174/346] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:27:59 2022] GET /compute/v2.1/servers/f7a58682-ab3a-45da-9529-56edbbaad8c9 => generated 1313 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:27:59.809851 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-fa83525c-ea82-4140-b327-c7763f81bf9b tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:27:59.810435 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-fa83525c-ea82-4140-b327-c7763f81bf9b tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] [instance: 8558ff08-5004-4dc4-892d-5b6610ce6bec] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:27:59.817486 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-fa83525c-ea82-4140-b327-c7763f81bf9b tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:27:59.817934 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-fa83525c-ea82-4140-b327-c7763f81bf9b tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:27:59.818786 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-fa83525c-ea82-4140-b327-c7763f81bf9b tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:27:59.819225 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-fa83525c-ea82-4140-b327-c7763f81bf9b tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:27:59.965995 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-fa83525c-ea82-4140-b327-c7763f81bf9b tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965cf2aad5bc4def9fca55aac87cc37e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32569df1dca45cebcdd63d03ff5abae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:27:59.973336 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-fa83525c-ea82-4140-b327-c7763f81bf9b tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] 10.222.0.46 "GET /compute/v2.1/servers/8558ff08-5004-4dc4-892d-5b6610ce6bec" status: 200 len: 1259 microversion: 2.1 time: 0.167640 Aug 04 05:27:59.973901 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 173/347] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:27:59 2022] GET /compute/v2.1/servers/8558ff08-5004-4dc4-892d-5b6610ce6bec => generated 1259 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:28:00.355378 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-e8f94eb3-196a-4ee0-b400-fd25ce1a65b8 tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:28:00.356043 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-e8f94eb3-196a-4ee0-b400-fd25ce1a65b8 tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] [instance: f7a58682-ab3a-45da-9529-56edbbaad8c9] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:28:00.358543 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG dbcounter [-] [118477] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=1 {{(pid=118477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:28:00.363235 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-e8f94eb3-196a-4ee0-b400-fd25ce1a65b8 tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:28:00.363726 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-e8f94eb3-196a-4ee0-b400-fd25ce1a65b8 tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:28:00.373931 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-e8f94eb3-196a-4ee0-b400-fd25ce1a65b8 tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:28:00.373931 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-e8f94eb3-196a-4ee0-b400-fd25ce1a65b8 tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:28:00.495544 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-e8f94eb3-196a-4ee0-b400-fd25ce1a65b8 tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d384cc766b4ef8bc0498f8fe3e5566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec163b07b5234a48ba80509ac693d8d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:28:00.503114 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-e8f94eb3-196a-4ee0-b400-fd25ce1a65b8 tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] 10.222.0.46 "GET /compute/v2.1/servers/f7a58682-ab3a-45da-9529-56edbbaad8c9" status: 200 len: 1313 microversion: 2.1 time: 0.151746 Aug 04 05:28:00.503711 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 175/348] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:28:00 2022] GET /compute/v2.1/servers/f7a58682-ab3a-45da-9529-56edbbaad8c9 => generated 1313 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:28:00.994133 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-c8096f7a-2595-4689-9d1a-c021111e133d tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:28:00.994766 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-c8096f7a-2595-4689-9d1a-c021111e133d tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] [instance: 8558ff08-5004-4dc4-892d-5b6610ce6bec] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:28:01.001343 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-c8096f7a-2595-4689-9d1a-c021111e133d tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:28:01.001790 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-c8096f7a-2595-4689-9d1a-c021111e133d tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:28:01.002578 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-c8096f7a-2595-4689-9d1a-c021111e133d tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:28:01.003010 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-c8096f7a-2595-4689-9d1a-c021111e133d tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:28:01.176668 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-c8096f7a-2595-4689-9d1a-c021111e133d tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965cf2aad5bc4def9fca55aac87cc37e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32569df1dca45cebcdd63d03ff5abae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:28:01.185508 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-c8096f7a-2595-4689-9d1a-c021111e133d tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] 10.222.0.46 "GET /compute/v2.1/servers/8558ff08-5004-4dc4-892d-5b6610ce6bec" status: 200 len: 1259 microversion: 2.1 time: 0.195419 Aug 04 05:28:01.186298 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 174/349] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:28:00 2022] GET /compute/v2.1/servers/8558ff08-5004-4dc4-892d-5b6610ce6bec => generated 1259 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:28:01.524662 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-00134968-c8cc-417f-bd5a-109d3637a5fa tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:28:01.525270 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-00134968-c8cc-417f-bd5a-109d3637a5fa tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] [instance: f7a58682-ab3a-45da-9529-56edbbaad8c9] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:28:01.531801 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-00134968-c8cc-417f-bd5a-109d3637a5fa tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:28:01.532321 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-00134968-c8cc-417f-bd5a-109d3637a5fa tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:28:01.533359 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-00134968-c8cc-417f-bd5a-109d3637a5fa tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:28:01.533755 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-00134968-c8cc-417f-bd5a-109d3637a5fa tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:28:01.670953 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-00134968-c8cc-417f-bd5a-109d3637a5fa tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d384cc766b4ef8bc0498f8fe3e5566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec163b07b5234a48ba80509ac693d8d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:28:01.678568 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-00134968-c8cc-417f-bd5a-109d3637a5fa tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] 10.222.0.46 "GET /compute/v2.1/servers/f7a58682-ab3a-45da-9529-56edbbaad8c9" status: 200 len: 1313 microversion: 2.1 time: 0.158519 Aug 04 05:28:01.679136 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 176/350] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:28:01 2022] GET /compute/v2.1/servers/f7a58682-ab3a-45da-9529-56edbbaad8c9 => generated 1313 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:28:02.206720 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-5bc3a0c9-564a-4b5d-bb7a-29acb5cba79b tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:28:02.207319 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-5bc3a0c9-564a-4b5d-bb7a-29acb5cba79b tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] [instance: 8558ff08-5004-4dc4-892d-5b6610ce6bec] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:28:02.214920 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-5bc3a0c9-564a-4b5d-bb7a-29acb5cba79b tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:28:02.215362 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-5bc3a0c9-564a-4b5d-bb7a-29acb5cba79b tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:28:02.216112 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-5bc3a0c9-564a-4b5d-bb7a-29acb5cba79b tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:28:02.216542 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-5bc3a0c9-564a-4b5d-bb7a-29acb5cba79b tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:28:02.361464 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-5bc3a0c9-564a-4b5d-bb7a-29acb5cba79b tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965cf2aad5bc4def9fca55aac87cc37e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32569df1dca45cebcdd63d03ff5abae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:28:02.365822 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-5bc3a0c9-564a-4b5d-bb7a-29acb5cba79b tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] 10.222.0.46 "GET /compute/v2.1/servers/8558ff08-5004-4dc4-892d-5b6610ce6bec" status: 200 len: 1259 microversion: 2.1 time: 0.162863 Aug 04 05:28:02.366481 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 175/351] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:28:02 2022] GET /compute/v2.1/servers/8558ff08-5004-4dc4-892d-5b6610ce6bec => generated 1259 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:28:02.699130 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-c6754856-6da4-4272-b342-226a136b025d tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:28:02.699684 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-c6754856-6da4-4272-b342-226a136b025d tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] [instance: f7a58682-ab3a-45da-9529-56edbbaad8c9] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:28:02.706222 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-c6754856-6da4-4272-b342-226a136b025d tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:28:02.706705 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-c6754856-6da4-4272-b342-226a136b025d tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:28:02.707493 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-c6754856-6da4-4272-b342-226a136b025d tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:28:02.707921 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-c6754856-6da4-4272-b342-226a136b025d tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:28:02.847994 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-c6754856-6da4-4272-b342-226a136b025d tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d384cc766b4ef8bc0498f8fe3e5566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec163b07b5234a48ba80509ac693d8d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:28:02.856612 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-c6754856-6da4-4272-b342-226a136b025d tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] 10.222.0.46 "GET /compute/v2.1/servers/f7a58682-ab3a-45da-9529-56edbbaad8c9" status: 200 len: 1313 microversion: 2.1 time: 0.161460 Aug 04 05:28:02.857430 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 177/352] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:28:02 2022] GET /compute/v2.1/servers/f7a58682-ab3a-45da-9529-56edbbaad8c9 => generated 1313 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:28:02.942600 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [req-04e6fa69-9825-492a-a9f1-9d190a71584c req-02817e27-a792-4ad6-affe-8912de53970f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f7a58682-ab3a-45da-9529-56edbbaad8c9", "name": "network-vif-plugged", "status": "completed", "tag": "9b046414-ec4f-452f-9f7a-a37617fdce1a"}]} {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:28:02.952227 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [req-04e6fa69-9825-492a-a9f1-9d190a71584c req-02817e27-a792-4ad6-affe-8912de53970f service nova] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:28:02.952620 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [req-04e6fa69-9825-492a-a9f1-9d190a71584c req-02817e27-a792-4ad6-affe-8912de53970f service nova] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:28:02.964109 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.compute.server_external_events [req-04e6fa69-9825-492a-a9f1-9d190a71584c req-02817e27-a792-4ad6-affe-8912de53970f service nova] Creating event network-vif-plugged:9b046414-ec4f-452f-9f7a-a37617fdce1a for instance f7a58682-ab3a-45da-9529-56edbbaad8c9 on hv-cinder-85207 Aug 04 05:28:02.969262 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [req-04e6fa69-9825-492a-a9f1-9d190a71584c req-02817e27-a792-4ad6-affe-8912de53970f service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030526 Aug 04 05:28:02.972826 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 176/353] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Aug 4 05:28:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:28:03.391057 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-29eedd42-6c64-4dee-8de6-483eb3afae48 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:28:03.391777 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-29eedd42-6c64-4dee-8de6-483eb3afae48 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] [instance: 8558ff08-5004-4dc4-892d-5b6610ce6bec] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:28:03.397942 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-29eedd42-6c64-4dee-8de6-483eb3afae48 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:28:03.398543 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-29eedd42-6c64-4dee-8de6-483eb3afae48 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:28:03.400009 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-29eedd42-6c64-4dee-8de6-483eb3afae48 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:28:03.400462 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-29eedd42-6c64-4dee-8de6-483eb3afae48 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:28:03.539870 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-29eedd42-6c64-4dee-8de6-483eb3afae48 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965cf2aad5bc4def9fca55aac87cc37e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32569df1dca45cebcdd63d03ff5abae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:28:03.547648 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-29eedd42-6c64-4dee-8de6-483eb3afae48 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] 10.222.0.46 "GET /compute/v2.1/servers/8558ff08-5004-4dc4-892d-5b6610ce6bec" status: 200 len: 1444 microversion: 2.1 time: 0.160666 Aug 04 05:28:03.548224 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 178/354] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:28:03 2022] GET /compute/v2.1/servers/8558ff08-5004-4dc4-892d-5b6610ce6bec => generated 1444 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:28:03.572124 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-ca693a0b-965b-4694-84e5-544748b2676e tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:28:03.572887 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-ca693a0b-965b-4694-84e5-544748b2676e tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] [instance: 8558ff08-5004-4dc4-892d-5b6610ce6bec] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:28:03.579101 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-ca693a0b-965b-4694-84e5-544748b2676e tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:28:03.580997 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-ca693a0b-965b-4694-84e5-544748b2676e tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:28:03.580997 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-ca693a0b-965b-4694-84e5-544748b2676e tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:28:03.580997 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-ca693a0b-965b-4694-84e5-544748b2676e tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:28:03.729220 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-ca693a0b-965b-4694-84e5-544748b2676e tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965cf2aad5bc4def9fca55aac87cc37e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32569df1dca45cebcdd63d03ff5abae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:28:03.736650 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-ca693a0b-965b-4694-84e5-544748b2676e tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] 10.222.0.46 "GET /compute/v2.1/servers/8558ff08-5004-4dc4-892d-5b6610ce6bec" status: 200 len: 1444 microversion: 2.1 time: 0.169964 Aug 04 05:28:03.737217 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 177/355] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:28:03 2022] GET /compute/v2.1/servers/8558ff08-5004-4dc4-892d-5b6610ce6bec => generated 1444 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:28:03.879469 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-0f1c9e3c-f7b4-486b-9f19-f641b5b58325 tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:28:03.879834 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-0f1c9e3c-f7b4-486b-9f19-f641b5b58325 tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] [instance: f7a58682-ab3a-45da-9529-56edbbaad8c9] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:28:03.887513 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-0f1c9e3c-f7b4-486b-9f19-f641b5b58325 tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:28:03.888155 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-0f1c9e3c-f7b4-486b-9f19-f641b5b58325 tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:28:03.889119 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-0f1c9e3c-f7b4-486b-9f19-f641b5b58325 tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:28:03.889701 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-0f1c9e3c-f7b4-486b-9f19-f641b5b58325 tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:28:04.067206 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-0f1c9e3c-f7b4-486b-9f19-f641b5b58325 tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d384cc766b4ef8bc0498f8fe3e5566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec163b07b5234a48ba80509ac693d8d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:28:04.067206 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-0f1c9e3c-f7b4-486b-9f19-f641b5b58325 tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] 10.222.0.46 "GET /compute/v2.1/servers/f7a58682-ab3a-45da-9529-56edbbaad8c9" status: 200 len: 1313 microversion: 2.1 time: 0.191153 Aug 04 05:28:04.067206 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 179/356] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:28:03 2022] GET /compute/v2.1/servers/f7a58682-ab3a-45da-9529-56edbbaad8c9 => generated 1313 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:28:05.088829 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-7de88359-044f-44f6-9cf2-58227a4cfcde tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:28:05.089423 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-7de88359-044f-44f6-9cf2-58227a4cfcde tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] [instance: f7a58682-ab3a-45da-9529-56edbbaad8c9] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:28:05.096020 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-7de88359-044f-44f6-9cf2-58227a4cfcde tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:28:05.113072 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-7de88359-044f-44f6-9cf2-58227a4cfcde tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:28:05.113072 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-7de88359-044f-44f6-9cf2-58227a4cfcde tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:28:05.113072 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-7de88359-044f-44f6-9cf2-58227a4cfcde tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:28:05.250697 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-7de88359-044f-44f6-9cf2-58227a4cfcde tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d384cc766b4ef8bc0498f8fe3e5566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec163b07b5234a48ba80509ac693d8d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:28:05.258322 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-7de88359-044f-44f6-9cf2-58227a4cfcde tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] 10.222.0.46 "GET /compute/v2.1/servers/f7a58682-ab3a-45da-9529-56edbbaad8c9" status: 200 len: 1313 microversion: 2.1 time: 0.173420 Aug 04 05:28:05.259840 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 178/357] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:28:05 2022] GET /compute/v2.1/servers/f7a58682-ab3a-45da-9529-56edbbaad8c9 => generated 1313 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:28:06.173451 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [req-8213c68b-e67a-4ee8-be49-5d6e44db6b6f req-53acc444-294e-40e5-a0ce-a3b3055f40c0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8558ff08-5004-4dc4-892d-5b6610ce6bec", "tag": "f7d972aa-2cea-4611-b9c7-a3bf2025197a"}]} {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:28:06.185341 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [req-8213c68b-e67a-4ee8-be49-5d6e44db6b6f req-53acc444-294e-40e5-a0ce-a3b3055f40c0 service nova] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:28:06.189123 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [req-8213c68b-e67a-4ee8-be49-5d6e44db6b6f req-53acc444-294e-40e5-a0ce-a3b3055f40c0 service nova] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:28:06.198317 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.compute.server_external_events [req-8213c68b-e67a-4ee8-be49-5d6e44db6b6f req-53acc444-294e-40e5-a0ce-a3b3055f40c0 service nova] Creating event network-changed:f7d972aa-2cea-4611-b9c7-a3bf2025197a for instance 8558ff08-5004-4dc4-892d-5b6610ce6bec on hv-cinder-85207 Aug 04 05:28:06.203506 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [req-8213c68b-e67a-4ee8-be49-5d6e44db6b6f req-53acc444-294e-40e5-a0ce-a3b3055f40c0 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034072 Aug 04 05:28:06.204102 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 180/358] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Aug 4 05:28:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:28:06.281788 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-5295631b-5053-4d3e-8b57-e113b25d2053 tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:28:06.282374 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-5295631b-5053-4d3e-8b57-e113b25d2053 tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] [instance: f7a58682-ab3a-45da-9529-56edbbaad8c9] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:28:06.289391 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-5295631b-5053-4d3e-8b57-e113b25d2053 tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:28:06.291420 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-5295631b-5053-4d3e-8b57-e113b25d2053 tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:28:06.292462 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-5295631b-5053-4d3e-8b57-e113b25d2053 tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:28:06.293032 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-5295631b-5053-4d3e-8b57-e113b25d2053 tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:28:06.573667 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-5295631b-5053-4d3e-8b57-e113b25d2053 tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d384cc766b4ef8bc0498f8fe3e5566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec163b07b5234a48ba80509ac693d8d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:28:06.585921 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-5295631b-5053-4d3e-8b57-e113b25d2053 tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] 10.222.0.46 "GET /compute/v2.1/servers/f7a58682-ab3a-45da-9529-56edbbaad8c9" status: 200 len: 1497 microversion: 2.1 time: 0.308144 Aug 04 05:28:06.586550 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 179/359] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:28:06 2022] GET /compute/v2.1/servers/f7a58682-ab3a-45da-9529-56edbbaad8c9 => generated 1497 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:28:07.807398 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-51045150-bfed-49e5-8dc4-95ea93521318 tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:28:07.808136 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-51045150-bfed-49e5-8dc4-95ea93521318 tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] [instance: f7a58682-ab3a-45da-9529-56edbbaad8c9] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:28:07.815043 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-51045150-bfed-49e5-8dc4-95ea93521318 tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:28:07.815494 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-51045150-bfed-49e5-8dc4-95ea93521318 tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:28:07.816257 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-51045150-bfed-49e5-8dc4-95ea93521318 tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:28:07.816683 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-51045150-bfed-49e5-8dc4-95ea93521318 tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:28:07.843678 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-51045150-bfed-49e5-8dc4-95ea93521318 tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] [instance: f7a58682-ab3a-45da-9529-56edbbaad8c9] Going to try to terminate instance {{(pid=118477) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 05:28:08.187169 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-51045150-bfed-49e5-8dc4-95ea93521318 tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] 10.222.0.46 "DELETE /compute/v2.1/servers/f7a58682-ab3a-45da-9529-56edbbaad8c9" status: 204 len: 0 microversion: 2.1 time: 0.384301 Aug 04 05:28:08.188012 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 181/360] 10.222.0.46 () {58 vars in 1239 bytes} [Thu Aug 4 05:28:07 2022] DELETE /compute/v2.1/servers/f7a58682-ab3a-45da-9529-56edbbaad8c9 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 04 05:28:08.196087 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-c3b61c68-81ea-4abc-b0ef-947592918cf6 tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:28:08.197025 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-c3b61c68-81ea-4abc-b0ef-947592918cf6 tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] [instance: f7a58682-ab3a-45da-9529-56edbbaad8c9] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:28:08.204868 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-c3b61c68-81ea-4abc-b0ef-947592918cf6 tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:28:08.205294 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-c3b61c68-81ea-4abc-b0ef-947592918cf6 tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:28:08.206058 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-c3b61c68-81ea-4abc-b0ef-947592918cf6 tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:28:08.206519 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-c3b61c68-81ea-4abc-b0ef-947592918cf6 tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:28:08.350668 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-c3b61c68-81ea-4abc-b0ef-947592918cf6 tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d384cc766b4ef8bc0498f8fe3e5566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec163b07b5234a48ba80509ac693d8d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:28:08.358931 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-c3b61c68-81ea-4abc-b0ef-947592918cf6 tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] 10.222.0.46 "GET /compute/v2.1/servers/f7a58682-ab3a-45da-9529-56edbbaad8c9" status: 200 len: 1503 microversion: 2.1 time: 0.166815 Aug 04 05:28:08.359613 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 180/361] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:28:08 2022] GET /compute/v2.1/servers/f7a58682-ab3a-45da-9529-56edbbaad8c9 => generated 1503 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 05:28:09.381291 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-570fa1d7-b600-4ac5-8dcd-20f13a2edf1a tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:28:09.381992 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-570fa1d7-b600-4ac5-8dcd-20f13a2edf1a tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] [instance: f7a58682-ab3a-45da-9529-56edbbaad8c9] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:28:09.389153 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-570fa1d7-b600-4ac5-8dcd-20f13a2edf1a tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:28:09.389755 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-570fa1d7-b600-4ac5-8dcd-20f13a2edf1a tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:28:09.390549 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-570fa1d7-b600-4ac5-8dcd-20f13a2edf1a tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:28:09.390984 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-570fa1d7-b600-4ac5-8dcd-20f13a2edf1a tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:28:09.523510 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-570fa1d7-b600-4ac5-8dcd-20f13a2edf1a tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d384cc766b4ef8bc0498f8fe3e5566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec163b07b5234a48ba80509ac693d8d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:28:09.532144 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-570fa1d7-b600-4ac5-8dcd-20f13a2edf1a tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] 10.222.0.46 "GET /compute/v2.1/servers/f7a58682-ab3a-45da-9529-56edbbaad8c9" status: 200 len: 1503 microversion: 2.1 time: 0.155098 Aug 04 05:28:09.533467 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 182/362] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:28:09 2022] GET /compute/v2.1/servers/f7a58682-ab3a-45da-9529-56edbbaad8c9 => generated 1503 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:28:10.556653 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-5905a4a0-12f8-49af-9968-8956c1e2e5a7 tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:28:10.557503 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-5905a4a0-12f8-49af-9968-8956c1e2e5a7 tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] [instance: f7a58682-ab3a-45da-9529-56edbbaad8c9] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:28:10.565111 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-5905a4a0-12f8-49af-9968-8956c1e2e5a7 tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:28:10.565849 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-5905a4a0-12f8-49af-9968-8956c1e2e5a7 tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:28:10.566832 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-5905a4a0-12f8-49af-9968-8956c1e2e5a7 tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:28:10.567270 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-5905a4a0-12f8-49af-9968-8956c1e2e5a7 tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:28:10.818577 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-5905a4a0-12f8-49af-9968-8956c1e2e5a7 tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d384cc766b4ef8bc0498f8fe3e5566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec163b07b5234a48ba80509ac693d8d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:28:10.826356 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-5905a4a0-12f8-49af-9968-8956c1e2e5a7 tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] 10.222.0.46 "GET /compute/v2.1/servers/f7a58682-ab3a-45da-9529-56edbbaad8c9" status: 200 len: 1503 microversion: 2.1 time: 0.273534 Aug 04 05:28:10.826954 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 181/363] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:28:10 2022] GET /compute/v2.1/servers/f7a58682-ab3a-45da-9529-56edbbaad8c9 => generated 1503 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:28:11.127712 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [req-23c0295b-9770-40d5-a7f4-7f55b926479b req-5e282c1f-5cc5-46e8-9e73-d17f098f1a7d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f7a58682-ab3a-45da-9529-56edbbaad8c9", "name": "network-vif-deleted", "tag": "9b046414-ec4f-452f-9f7a-a37617fdce1a"}]} {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:28:11.137658 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [req-23c0295b-9770-40d5-a7f4-7f55b926479b req-5e282c1f-5cc5-46e8-9e73-d17f098f1a7d service nova] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:28:11.138103 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [req-23c0295b-9770-40d5-a7f4-7f55b926479b req-5e282c1f-5cc5-46e8-9e73-d17f098f1a7d service nova] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:28:11.149768 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.compute.server_external_events [req-23c0295b-9770-40d5-a7f4-7f55b926479b req-5e282c1f-5cc5-46e8-9e73-d17f098f1a7d service nova] Creating event network-vif-deleted:9b046414-ec4f-452f-9f7a-a37617fdce1a for instance f7a58682-ab3a-45da-9529-56edbbaad8c9 on hv-cinder-85207 Aug 04 05:28:11.154867 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [req-23c0295b-9770-40d5-a7f4-7f55b926479b req-5e282c1f-5cc5-46e8-9e73-d17f098f1a7d service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030730 Aug 04 05:28:11.160025 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 183/364] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Aug 4 05:28:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:28:11.848996 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-762dabdd-b3ac-49e7-9107-c5b2eccbdb7d tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:28:11.849717 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-762dabdd-b3ac-49e7-9107-c5b2eccbdb7d tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] [instance: f7a58682-ab3a-45da-9529-56edbbaad8c9] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:28:11.856924 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-762dabdd-b3ac-49e7-9107-c5b2eccbdb7d tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:28:11.857371 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-762dabdd-b3ac-49e7-9107-c5b2eccbdb7d tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:28:11.858226 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-762dabdd-b3ac-49e7-9107-c5b2eccbdb7d tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:28:11.858695 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-762dabdd-b3ac-49e7-9107-c5b2eccbdb7d tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:28:11.890331 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-762dabdd-b3ac-49e7-9107-c5b2eccbdb7d tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:28:11.890806 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-762dabdd-b3ac-49e7-9107-c5b2eccbdb7d tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:28:11.891258 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.objects.instance [None req-762dabdd-b3ac-49e7-9107-c5b2eccbdb7d tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] Lazy-loading 'fault' on Instance uuid f7a58682-ab3a-45da-9529-56edbbaad8c9 {{(pid=118476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 05:28:11.933371 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-762dabdd-b3ac-49e7-9107-c5b2eccbdb7d tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d384cc766b4ef8bc0498f8fe3e5566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec163b07b5234a48ba80509ac693d8d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:28:11.941055 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-762dabdd-b3ac-49e7-9107-c5b2eccbdb7d tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] 10.222.0.46 "GET /compute/v2.1/servers/f7a58682-ab3a-45da-9529-56edbbaad8c9" status: 200 len: 1303 microversion: 2.1 time: 0.095936 Aug 04 05:28:11.941628 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 182/365] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:28:11 2022] GET /compute/v2.1/servers/f7a58682-ab3a-45da-9529-56edbbaad8c9 => generated 1303 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:28:12.963885 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-79411945-d320-42d1-9a47-fc311876f652 tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:28:12.964577 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-79411945-d320-42d1-9a47-fc311876f652 tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] [instance: f7a58682-ab3a-45da-9529-56edbbaad8c9] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:28:12.970879 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-79411945-d320-42d1-9a47-fc311876f652 tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:28:12.971322 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-79411945-d320-42d1-9a47-fc311876f652 tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:28:12.972079 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-79411945-d320-42d1-9a47-fc311876f652 tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:28:12.972509 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-79411945-d320-42d1-9a47-fc311876f652 tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:28:12.987261 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.wsgi [None req-79411945-d320-42d1-9a47-fc311876f652 tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] HTTP exception thrown: Instance f7a58682-ab3a-45da-9529-56edbbaad8c9 could not be found. Aug 04 05:28:12.988859 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-79411945-d320-42d1-9a47-fc311876f652 tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] Request method failure captured: Aug 04 05:28:12.988859 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: request: GET /compute/v2.1/servers/f7a58682-ab3a-45da-9529-56edbbaad8c9 HTTP/1.1 Aug 04 05:28:12.988859 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: Accept: application/json Aug 04 05:28:12.988859 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: Accept-Encoding: identity Aug 04 05:28:12.988859 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: Connection: close Aug 04 05:28:12.988859 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: Content-Length: 0 Aug 04 05:28:12.988859 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: Content-Type: application/json Aug 04 05:28:12.988859 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: Host: 10.222.0.46 Aug 04 05:28:12.988859 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: Openstack-System-Scope: None Aug 04 05:28:12.988859 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: User-Agent: python-urllib3/1.26.11 Aug 04 05:28:12.988859 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Auth-Token: gAAAAABi61ixcM8PFJpCisISYbCPWdIhHZFumWWcJrJeNZnMMFPirXIGp4BqPBXV9orV3QS1Qhz_jyJ6Wd8UTmiwbXLtIx2bSUf3Yts6EwJel8JDC-0Sp4x4eI77__shBPv3XKACXZYTrXf2oSBtCeysdgXBIbtI-9eUZE-pmNIoK_KHA-ABof4 Aug 04 05:28:12.988859 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Domain-Id: None Aug 04 05:28:12.988859 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Domain-Name: None Aug 04 05:28:12.988859 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Identity-Status: Confirmed Aug 04 05:28:12.988859 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Is-Admin-Project: True Aug 04 05:28:12.988859 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Project-Domain-Id: default Aug 04 05:28:12.988859 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Project-Domain-Name: Default Aug 04 05:28:12.988859 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Project-Id: ec163b07b5234a48ba80509ac693d8d3 Aug 04 05:28:12.988859 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Project-Name: tempest-VolumesActionsTest-839816448 Aug 04 05:28:12.988859 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Role: member,reader Aug 04 05:28:12.988859 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Roles: member,reader Aug 04 05:28:12.990468 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/ec163b07b5234a48ba80509ac693d8d3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/ec163b07b5234a48ba80509ac693d8d3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_ec163b07b5234a48ba80509ac693d8d3", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/ec163b07b5234a48ba80509ac693d8d3"}]}] Aug 04 05:28:12.990468 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Tenant: tempest-VolumesActionsTest-839816448 Aug 04 05:28:12.990468 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Tenant-Id: ec163b07b5234a48ba80509ac693d8d3 Aug 04 05:28:12.990468 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Tenant-Name: tempest-VolumesActionsTest-839816448 Aug 04 05:28:12.990468 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-User: tempest-VolumesActionsTest-839816448-project Aug 04 05:28:12.990468 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-User-Domain-Id: default Aug 04 05:28:12.990468 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-User-Domain-Name: Default Aug 04 05:28:12.990468 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-User-Id: 02d384cc766b4ef8bc0498f8fe3e5566 Aug 04 05:28:12.990468 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-User-Name: tempest-VolumesActionsTest-839816448-project Aug 04 05:28:12.990468 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: method: > Aug 04 05:28:12.990468 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: exception: Instance f7a58682-ab3a-45da-9529-56edbbaad8c9 could not be found. Aug 04 05:28:12.990468 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: action_args: {'id': 'f7a58682-ab3a-45da-9529-56edbbaad8c9'} Aug 04 05:28:12.991339 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 05:28:12.991339 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:28:12.991339 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 05:28:12.991339 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 05:28:12.991339 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 05:28:12.991339 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 05:28:12.991339 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 05:28:12.991339 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 05:28:12.991339 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 05:28:12.991339 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 05:28:12.991339 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f7a58682-ab3a-45da-9529-56edbbaad8c9 could not be found. Aug 04 05:28:12.991339 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Aug 04 05:28:12.991339 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:28:12.991339 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Aug 04 05:28:12.991339 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:28:12.991339 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:28:12.991339 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:28:12.991339 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 05:28:12.991339 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 05:28:12.991339 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 05:28:12.992842 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 05:28:12.992842 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 05:28:12.992842 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 05:28:12.992842 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 05:28:12.992842 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 05:28:12.992842 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 05:28:12.992842 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 05:28:12.992842 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f7a58682-ab3a-45da-9529-56edbbaad8c9 could not be found. Aug 04 05:28:12.992842 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Aug 04 05:28:12.992842 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:28:12.992842 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Aug 04 05:28:12.992842 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:28:12.992842 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:28:12.992842 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:28:12.992842 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 05:28:12.992842 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 05:28:12.992842 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f7a58682-ab3a-45da-9529-56edbbaad8c9 could not be found. Aug 04 05:28:12.992842 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Aug 04 05:28:12.994284 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-79411945-d320-42d1-9a47-fc311876f652 tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] Returning 404 to user: Instance f7a58682-ab3a-45da-9529-56edbbaad8c9 could not be found. {{(pid=118477) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 05:28:12.994284 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-79411945-d320-42d1-9a47-fc311876f652 tempest-VolumesActionsTest-839816448 tempest-VolumesActionsTest-839816448-project] 10.222.0.46 "GET /compute/v2.1/servers/f7a58682-ab3a-45da-9529-56edbbaad8c9" status: 404 len: 111 microversion: 2.1 time: 0.031914 Aug 04 05:28:12.994284 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 184/366] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:28:12 2022] GET /compute/v2.1/servers/f7a58682-ab3a-45da-9529-56edbbaad8c9 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 05:28:14.088390 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-2871d2e6-068e-487f-9741-a8e8923644ca tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:28:14.089082 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-2871d2e6-068e-487f-9741-a8e8923644ca tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] [instance: 9333850c-071c-4330-98b9-84232a752ffe] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:28:14.095378 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-2871d2e6-068e-487f-9741-a8e8923644ca tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:28:14.095832 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-2871d2e6-068e-487f-9741-a8e8923644ca tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:28:14.096595 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-2871d2e6-068e-487f-9741-a8e8923644ca tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:28:14.097033 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-2871d2e6-068e-487f-9741-a8e8923644ca tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:28:14.114516 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG dbcounter [-] [118476] Writing DB stats nova_cell1:SELECT=100 {{(pid=118476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:28:14.121928 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-2871d2e6-068e-487f-9741-a8e8923644ca tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] 10.222.0.46 "GET /compute/v2.1/servers/9333850c-071c-4330-98b9-84232a752ffe/ips" status: 200 len: 145 microversion: 2.1 time: 0.038058 Aug 04 05:28:14.122537 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 183/367] 10.222.0.46 () {58 vars in 1248 bytes} [Thu Aug 4 05:28:14 2022] GET /compute/v2.1/servers/9333850c-071c-4330-98b9-84232a752ffe/ips => generated 145 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:28:19.454252 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-3f933e88-5e66-4c75-986e-c38a97ac77a0 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cfa2cc95-1cb6-463d-9a1e-1c539936a0af"}} {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:28:19.456527 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-3f933e88-5e66-4c75-986e-c38a97ac77a0 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] [instance: 9333850c-071c-4330-98b9-84232a752ffe] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:28:19.463760 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-3f933e88-5e66-4c75-986e-c38a97ac77a0 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:28:19.464301 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-3f933e88-5e66-4c75-986e-c38a97ac77a0 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:28:19.465052 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-3f933e88-5e66-4c75-986e-c38a97ac77a0 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:28:19.465478 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-3f933e88-5e66-4c75-986e-c38a97ac77a0 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:28:19.536786 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG dbcounter [-] [118477] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:28:22.767549 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-3f933e88-5e66-4c75-986e-c38a97ac77a0 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] 10.222.0.46 "POST /compute/v2.1/servers/9333850c-071c-4330-98b9-84232a752ffe/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.317033 Aug 04 05:28:22.768822 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 185/368] 10.222.0.46 () {60 vars in 1323 bytes} [Thu Aug 4 05:28:19 2022] POST /compute/v2.1/servers/9333850c-071c-4330-98b9-84232a752ffe/os-volume_attachments => generated 194 bytes in 3318 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:28:33.700470 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-d2785718-a63f-4ac8-8856-298cf9ffefc5 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:28:33.707962 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG dbcounter [-] [118476] Writing DB stats nova_api:INSERT=1,nova_api:SELECT=50 {{(pid=118476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:28:33.709967 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-d2785718-a63f-4ac8-8856-298cf9ffefc5 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:28:33.710736 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-d2785718-a63f-4ac8-8856-298cf9ffefc5 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:28:33.801498 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-d2785718-a63f-4ac8-8856-298cf9ffefc5 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] [instance: 9333850c-071c-4330-98b9-84232a752ffe] Going to try to stop instance {{(pid=118476) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 04 05:28:34.035843 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-d2785718-a63f-4ac8-8856-298cf9ffefc5 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] 10.222.0.46 "POST /compute/v2.1/servers/9333850c-071c-4330-98b9-84232a752ffe/action" status: 202 len: 0 microversion: 2.1 time: 0.343521 Aug 04 05:28:34.036972 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 184/369] 10.222.0.46 () {60 vars in 1278 bytes} [Thu Aug 4 05:28:33 2022] POST /compute/v2.1/servers/9333850c-071c-4330-98b9-84232a752ffe/action => generated 0 bytes in 346 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 05:28:34.044300 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG dbcounter [-] [118477] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=1 {{(pid=118477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:28:34.046180 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG dbcounter [-] [118477] Writing DB stats nova_cell1:SELECT=6,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:28:34.053192 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-df73815f-9065-4058-bc67-3cfa4ec0006a tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:28:34.055010 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-df73815f-9065-4058-bc67-3cfa4ec0006a tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] [instance: 9333850c-071c-4330-98b9-84232a752ffe] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:28:34.063319 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-df73815f-9065-4058-bc67-3cfa4ec0006a tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:28:34.064363 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-df73815f-9065-4058-bc67-3cfa4ec0006a tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:28:34.064791 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-df73815f-9065-4058-bc67-3cfa4ec0006a tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:28:34.065249 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-df73815f-9065-4058-bc67-3cfa4ec0006a tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:28:34.277478 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-df73815f-9065-4058-bc67-3cfa4ec0006a tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb4dea95659c473b9b193c6234186430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1ca4b83dc874bda9f33e06f4910608c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:28:34.288438 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-df73815f-9065-4058-bc67-3cfa4ec0006a tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] 10.222.0.46 "GET /compute/v2.1/servers/9333850c-071c-4330-98b9-84232a752ffe" status: 200 len: 1723 microversion: 2.1 time: 0.245909 Aug 04 05:28:34.289782 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 186/370] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:28:34 2022] GET /compute/v2.1/servers/9333850c-071c-4330-98b9-84232a752ffe => generated 1723 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:28:35.314720 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-c38f4330-9888-44b8-b284-690a39df3c6f tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:28:35.315434 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-c38f4330-9888-44b8-b284-690a39df3c6f tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] [instance: 9333850c-071c-4330-98b9-84232a752ffe] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:28:35.322648 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-c38f4330-9888-44b8-b284-690a39df3c6f tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:28:35.325561 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-c38f4330-9888-44b8-b284-690a39df3c6f tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:28:35.325561 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-c38f4330-9888-44b8-b284-690a39df3c6f tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:28:35.325561 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-c38f4330-9888-44b8-b284-690a39df3c6f tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:28:35.520468 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-c38f4330-9888-44b8-b284-690a39df3c6f tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb4dea95659c473b9b193c6234186430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1ca4b83dc874bda9f33e06f4910608c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:28:35.532112 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-c38f4330-9888-44b8-b284-690a39df3c6f tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] 10.222.0.46 "GET /compute/v2.1/servers/9333850c-071c-4330-98b9-84232a752ffe" status: 200 len: 1723 microversion: 2.1 time: 0.222611 Aug 04 05:28:35.533288 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 185/371] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:28:35 2022] GET /compute/v2.1/servers/9333850c-071c-4330-98b9-84232a752ffe => generated 1723 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:28:36.557365 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-14f9f8fe-8500-439d-b734-113b719fbed6 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:28:36.558396 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-14f9f8fe-8500-439d-b734-113b719fbed6 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] [instance: 9333850c-071c-4330-98b9-84232a752ffe] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:28:36.572772 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-14f9f8fe-8500-439d-b734-113b719fbed6 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:28:36.573269 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-14f9f8fe-8500-439d-b734-113b719fbed6 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:28:36.574432 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-14f9f8fe-8500-439d-b734-113b719fbed6 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:28:36.579331 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-14f9f8fe-8500-439d-b734-113b719fbed6 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:28:36.734143 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-14f9f8fe-8500-439d-b734-113b719fbed6 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb4dea95659c473b9b193c6234186430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1ca4b83dc874bda9f33e06f4910608c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:28:36.744343 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-14f9f8fe-8500-439d-b734-113b719fbed6 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] 10.222.0.46 "GET /compute/v2.1/servers/9333850c-071c-4330-98b9-84232a752ffe" status: 200 len: 1723 microversion: 2.1 time: 0.191174 Aug 04 05:28:36.745153 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 187/372] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:28:36 2022] GET /compute/v2.1/servers/9333850c-071c-4330-98b9-84232a752ffe => generated 1723 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:28:37.772374 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-7939cb36-27db-4f82-bf92-67330b26aeda tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:28:37.773068 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-7939cb36-27db-4f82-bf92-67330b26aeda tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] [instance: 9333850c-071c-4330-98b9-84232a752ffe] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:28:37.780574 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-7939cb36-27db-4f82-bf92-67330b26aeda tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:28:37.781025 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-7939cb36-27db-4f82-bf92-67330b26aeda tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:28:37.781798 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-7939cb36-27db-4f82-bf92-67330b26aeda tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:28:37.782229 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-7939cb36-27db-4f82-bf92-67330b26aeda tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:28:37.941493 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-7939cb36-27db-4f82-bf92-67330b26aeda tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb4dea95659c473b9b193c6234186430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1ca4b83dc874bda9f33e06f4910608c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:28:37.950246 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-7939cb36-27db-4f82-bf92-67330b26aeda tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] 10.222.0.46 "GET /compute/v2.1/servers/9333850c-071c-4330-98b9-84232a752ffe" status: 200 len: 1723 microversion: 2.1 time: 0.181833 Aug 04 05:28:37.950881 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 186/373] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:28:37 2022] GET /compute/v2.1/servers/9333850c-071c-4330-98b9-84232a752ffe => generated 1723 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:28:38.972802 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-6eb1884b-0945-4d3b-a6c2-453c452954b2 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:28:38.973412 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-6eb1884b-0945-4d3b-a6c2-453c452954b2 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] [instance: 9333850c-071c-4330-98b9-84232a752ffe] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:28:38.980212 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-6eb1884b-0945-4d3b-a6c2-453c452954b2 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:28:38.980658 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-6eb1884b-0945-4d3b-a6c2-453c452954b2 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:28:38.981409 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-6eb1884b-0945-4d3b-a6c2-453c452954b2 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:28:38.981836 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-6eb1884b-0945-4d3b-a6c2-453c452954b2 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:28:39.120028 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-6eb1884b-0945-4d3b-a6c2-453c452954b2 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb4dea95659c473b9b193c6234186430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1ca4b83dc874bda9f33e06f4910608c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:28:39.127980 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-6eb1884b-0945-4d3b-a6c2-453c452954b2 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] 10.222.0.46 "GET /compute/v2.1/servers/9333850c-071c-4330-98b9-84232a752ffe" status: 200 len: 1723 microversion: 2.1 time: 0.159024 Aug 04 05:28:39.128548 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 188/374] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:28:38 2022] GET /compute/v2.1/servers/9333850c-071c-4330-98b9-84232a752ffe => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:28:40.155269 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-5b6512a6-fc3d-4cea-99cb-f6181970c2a7 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:28:40.156070 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-5b6512a6-fc3d-4cea-99cb-f6181970c2a7 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] [instance: 9333850c-071c-4330-98b9-84232a752ffe] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:28:40.162940 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-5b6512a6-fc3d-4cea-99cb-f6181970c2a7 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:28:40.163585 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-5b6512a6-fc3d-4cea-99cb-f6181970c2a7 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:28:40.164330 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-5b6512a6-fc3d-4cea-99cb-f6181970c2a7 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:28:40.164771 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-5b6512a6-fc3d-4cea-99cb-f6181970c2a7 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:28:40.244937 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-fbcbcd91-513d-4508-961e-28d3c4057e0b tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:28:40.245495 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-fbcbcd91-513d-4508-961e-28d3c4057e0b tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] [instance: b7dd37ec-81bf-4c77-90dc-eecb897d9d19] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:28:40.253028 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-fbcbcd91-513d-4508-961e-28d3c4057e0b tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:28:40.253553 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-fbcbcd91-513d-4508-961e-28d3c4057e0b tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:28:40.254528 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-fbcbcd91-513d-4508-961e-28d3c4057e0b tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:28:40.254956 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-fbcbcd91-513d-4508-961e-28d3c4057e0b tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:28:40.280826 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-fbcbcd91-513d-4508-961e-28d3c4057e0b tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] 10.222.0.46 "GET /compute/v2.1/servers/b7dd37ec-81bf-4c77-90dc-eecb897d9d19/ips" status: 200 len: 150 microversion: 2.1 time: 0.048657 Aug 04 05:28:40.281408 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 189/375] 10.222.0.46 () {58 vars in 1248 bytes} [Thu Aug 4 05:28:40 2022] GET /compute/v2.1/servers/b7dd37ec-81bf-4c77-90dc-eecb897d9d19/ips => generated 150 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 05:28:40.294492 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-4ae334f4-dcc7-4987-9162-e4bf4c893fc7 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2df06300-47c9-4304-818b-31a0903cd559"}} {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:28:40.296952 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-4ae334f4-dcc7-4987-9162-e4bf4c893fc7 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] [instance: b7dd37ec-81bf-4c77-90dc-eecb897d9d19] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:28:40.303283 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-4ae334f4-dcc7-4987-9162-e4bf4c893fc7 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:28:40.303827 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-4ae334f4-dcc7-4987-9162-e4bf4c893fc7 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:28:40.304740 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-4ae334f4-dcc7-4987-9162-e4bf4c893fc7 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:28:40.305254 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-4ae334f4-dcc7-4987-9162-e4bf4c893fc7 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:28:40.307934 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-5b6512a6-fc3d-4cea-99cb-f6181970c2a7 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb4dea95659c473b9b193c6234186430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1ca4b83dc874bda9f33e06f4910608c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:28:40.316928 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-5b6512a6-fc3d-4cea-99cb-f6181970c2a7 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] 10.222.0.46 "GET /compute/v2.1/servers/9333850c-071c-4330-98b9-84232a752ffe" status: 200 len: 1723 microversion: 2.1 time: 0.165528 Aug 04 05:28:40.317647 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 187/376] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:28:40 2022] GET /compute/v2.1/servers/9333850c-071c-4330-98b9-84232a752ffe => generated 1723 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:28:40.388918 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.wsgi [None req-4ae334f4-dcc7-4987-9162-e4bf4c893fc7 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] HTTP exception thrown: Invalid volume: volume 2df06300-47c9-4304-818b-31a0903cd559 is already attached to instances: 384721d7-1467-45cd-af93-eb458115f75e Aug 04 05:28:40.390680 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-4ae334f4-dcc7-4987-9162-e4bf4c893fc7 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Request method failure captured: Aug 04 05:28:40.390680 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: request: POST /compute/v2.1/servers/b7dd37ec-81bf-4c77-90dc-eecb897d9d19/os-volume_attachments HTTP/1.1 Aug 04 05:28:40.390680 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: Accept: application/json Aug 04 05:28:40.390680 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: Accept-Encoding: identity Aug 04 05:28:40.390680 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: Connection: close Aug 04 05:28:40.390680 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: Content-Length: 74 Aug 04 05:28:40.390680 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: Content-Type: application/json Aug 04 05:28:40.390680 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: Host: 10.222.0.46 Aug 04 05:28:40.390680 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: Openstack-System-Scope: None Aug 04 05:28:40.390680 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: User-Agent: python-urllib3/1.26.11 Aug 04 05:28:40.390680 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Auth-Token: gAAAAABi61g0x_8sFigG1jfXTOdqOMY1_3lK7UxaN3VmL5lqQXtIkCz4pWJYdYey2zGuiTigaV5gr0UWhaKZvxst4Kz-KOaAO64aM30ubWqVQfLIrJqf-RP6LF-c0ZabM-LUcJmxEmCuhHsUTEzNbVJn1WT0ja1hpuQC9pVY6l0Uzp1TYNzYyh0 Aug 04 05:28:40.390680 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Domain-Id: None Aug 04 05:28:40.390680 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Domain-Name: None Aug 04 05:28:40.390680 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Identity-Status: Confirmed Aug 04 05:28:40.390680 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Is-Admin-Project: True Aug 04 05:28:40.390680 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Project-Domain-Id: default Aug 04 05:28:40.390680 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Project-Domain-Name: Default Aug 04 05:28:40.390680 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Project-Id: faead990837d43de8ec54bfaf24361de Aug 04 05:28:40.390680 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Project-Name: tempest-AttachVolumeNegativeTest-710656709 Aug 04 05:28:40.390680 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Role: member,reader Aug 04 05:28:40.390680 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Roles: member,reader Aug 04 05:28:40.392296 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/faead990837d43de8ec54bfaf24361de"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/faead990837d43de8ec54bfaf24361de"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_faead990837d43de8ec54bfaf24361de", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/faead990837d43de8ec54bfaf24361de"}]}] Aug 04 05:28:40.392296 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Tenant: tempest-AttachVolumeNegativeTest-710656709 Aug 04 05:28:40.392296 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Tenant-Id: faead990837d43de8ec54bfaf24361de Aug 04 05:28:40.392296 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-710656709 Aug 04 05:28:40.392296 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-User: tempest-AttachVolumeNegativeTest-710656709-project Aug 04 05:28:40.392296 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-User-Domain-Id: default Aug 04 05:28:40.392296 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-User-Domain-Name: Default Aug 04 05:28:40.392296 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-User-Id: 9cb49b631c234f9a9fd47049b9b2e097 Aug 04 05:28:40.392296 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-User-Name: tempest-AttachVolumeNegativeTest-710656709-project Aug 04 05:28:40.392296 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: Aug 04 05:28:40.392296 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: {"volumeAttachment": {"volumeId": "2df06300-47c9-4304-818b-31a0903cd559"}} Aug 04 05:28:40.392296 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: method: > Aug 04 05:28:40.393218 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: exception: Invalid volume: volume 2df06300-47c9-4304-818b-31a0903cd559 is already attached to instances: 384721d7-1467-45cd-af93-eb458115f75e Aug 04 05:28:40.393218 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: action_args: {'server_id': 'b7dd37ec-81bf-4c77-90dc-eecb897d9d19', 'body': {'volumeAttachment': {'volumeId': '2df06300-47c9-4304-818b-31a0903cd559'}}} Aug 04 05:28:40.393218 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 05:28:40.393218 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:28:40.393218 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 04 05:28:40.393218 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 04 05:28:40.393218 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 04 05:28:40.393218 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 04 05:28:40.393218 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 04 05:28:40.393218 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 04 05:28:40.393218 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5066, in attach_volume Aug 04 05:28:40.393218 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 04 05:28:40.393218 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4906, in _check_volume_already_attached Aug 04 05:28:40.393218 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 04 05:28:40.393218 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 2df06300-47c9-4304-818b-31a0903cd559 is already attached to instances: 384721d7-1467-45cd-af93-eb458115f75e Aug 04 05:28:40.393218 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Aug 04 05:28:40.393218 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:28:40.393218 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Aug 04 05:28:40.393218 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:28:40.394896 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:28:40.394896 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:28:40.394896 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 05:28:40.394896 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 05:28:40.394896 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 05:28:40.394896 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 05:28:40.394896 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 05:28:40.394896 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 05:28:40.394896 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 05:28:40.394896 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 05:28:40.394896 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 05:28:40.394896 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 05:28:40.394896 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 04 05:28:40.394896 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 04 05:28:40.394896 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 2df06300-47c9-4304-818b-31a0903cd559 is already attached to instances: 384721d7-1467-45cd-af93-eb458115f75e Aug 04 05:28:40.394896 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Aug 04 05:28:40.394896 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:28:40.394896 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Aug 04 05:28:40.394896 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:28:40.394896 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:28:40.396530 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:28:40.396530 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 05:28:40.396530 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 05:28:40.396530 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 2df06300-47c9-4304-818b-31a0903cd559 is already attached to instances: 384721d7-1467-45cd-af93-eb458115f75e Aug 04 05:28:40.396530 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Aug 04 05:28:40.396530 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-4ae334f4-dcc7-4987-9162-e4bf4c893fc7 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Returning 400 to user: Invalid volume: volume 2df06300-47c9-4304-818b-31a0903cd559 is already attached to instances: 384721d7-1467-45cd-af93-eb458115f75e {{(pid=118477) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 05:28:40.396530 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-4ae334f4-dcc7-4987-9162-e4bf4c893fc7 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] 10.222.0.46 "POST /compute/v2.1/servers/b7dd37ec-81bf-4c77-90dc-eecb897d9d19/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.102182 Aug 04 05:28:40.396530 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 190/377] 10.222.0.46 () {60 vars in 1323 bytes} [Thu Aug 4 05:28:40 2022] POST /compute/v2.1/servers/b7dd37ec-81bf-4c77-90dc-eecb897d9d19/os-volume_attachments => generated 174 bytes in 103 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 04 05:28:40.402411 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-ec86291d-8879-40f3-a28a-696faa95088d tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:28:40.405992 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-ec86291d-8879-40f3-a28a-696faa95088d tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] [instance: b7dd37ec-81bf-4c77-90dc-eecb897d9d19] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:28:40.409251 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-ec86291d-8879-40f3-a28a-696faa95088d tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:28:40.409696 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-ec86291d-8879-40f3-a28a-696faa95088d tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:28:40.410568 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-ec86291d-8879-40f3-a28a-696faa95088d tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:28:40.411020 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-ec86291d-8879-40f3-a28a-696faa95088d tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:28:40.438625 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-ec86291d-8879-40f3-a28a-696faa95088d tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] [instance: b7dd37ec-81bf-4c77-90dc-eecb897d9d19] Going to try to terminate instance {{(pid=118476) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 05:28:40.723015 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-ec86291d-8879-40f3-a28a-696faa95088d tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] 10.222.0.46 "DELETE /compute/v2.1/servers/b7dd37ec-81bf-4c77-90dc-eecb897d9d19" status: 204 len: 0 microversion: 2.1 time: 0.324801 Aug 04 05:28:40.723685 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 188/378] 10.222.0.46 () {58 vars in 1239 bytes} [Thu Aug 4 05:28:40 2022] DELETE /compute/v2.1/servers/b7dd37ec-81bf-4c77-90dc-eecb897d9d19 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 05:28:40.733889 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-1739f210-59f6-4281-9bdc-2bd3f9100e03 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:28:40.734568 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-1739f210-59f6-4281-9bdc-2bd3f9100e03 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] [instance: b7dd37ec-81bf-4c77-90dc-eecb897d9d19] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:28:40.741750 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-1739f210-59f6-4281-9bdc-2bd3f9100e03 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:28:40.742395 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-1739f210-59f6-4281-9bdc-2bd3f9100e03 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:28:40.743232 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-1739f210-59f6-4281-9bdc-2bd3f9100e03 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:28:40.745137 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-1739f210-59f6-4281-9bdc-2bd3f9100e03 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:28:40.891298 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-1739f210-59f6-4281-9bdc-2bd3f9100e03 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb49b631c234f9a9fd47049b9b2e097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faead990837d43de8ec54bfaf24361de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:28:40.899357 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-1739f210-59f6-4281-9bdc-2bd3f9100e03 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] 10.222.0.46 "GET /compute/v2.1/servers/b7dd37ec-81bf-4c77-90dc-eecb897d9d19" status: 200 len: 1682 microversion: 2.1 time: 0.171232 Aug 04 05:28:40.900495 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 191/379] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:28:40 2022] GET /compute/v2.1/servers/b7dd37ec-81bf-4c77-90dc-eecb897d9d19 => generated 1682 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:28:41.340822 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-e8746013-af41-4b27-b5be-c4551a9144a4 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:28:41.341552 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-e8746013-af41-4b27-b5be-c4551a9144a4 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] [instance: 9333850c-071c-4330-98b9-84232a752ffe] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:28:41.348034 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-e8746013-af41-4b27-b5be-c4551a9144a4 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:28:41.348478 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-e8746013-af41-4b27-b5be-c4551a9144a4 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:28:41.349232 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-e8746013-af41-4b27-b5be-c4551a9144a4 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:28:41.349660 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-e8746013-af41-4b27-b5be-c4551a9144a4 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:28:41.488388 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-e8746013-af41-4b27-b5be-c4551a9144a4 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb4dea95659c473b9b193c6234186430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1ca4b83dc874bda9f33e06f4910608c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:28:41.497674 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-e8746013-af41-4b27-b5be-c4551a9144a4 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] 10.222.0.46 "GET /compute/v2.1/servers/9333850c-071c-4330-98b9-84232a752ffe" status: 200 len: 1723 microversion: 2.1 time: 0.161922 Aug 04 05:28:41.498269 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 189/380] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:28:41 2022] GET /compute/v2.1/servers/9333850c-071c-4330-98b9-84232a752ffe => generated 1723 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:28:41.923562 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-54ed3216-363e-4858-904c-aa4037ee8ac0 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:28:41.924187 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-54ed3216-363e-4858-904c-aa4037ee8ac0 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] [instance: b7dd37ec-81bf-4c77-90dc-eecb897d9d19] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:28:41.930579 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-54ed3216-363e-4858-904c-aa4037ee8ac0 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:28:41.931020 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-54ed3216-363e-4858-904c-aa4037ee8ac0 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:28:41.931879 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-54ed3216-363e-4858-904c-aa4037ee8ac0 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:28:41.932344 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-54ed3216-363e-4858-904c-aa4037ee8ac0 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:28:42.079679 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-54ed3216-363e-4858-904c-aa4037ee8ac0 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb49b631c234f9a9fd47049b9b2e097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faead990837d43de8ec54bfaf24361de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:28:42.088113 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-54ed3216-363e-4858-904c-aa4037ee8ac0 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] 10.222.0.46 "GET /compute/v2.1/servers/b7dd37ec-81bf-4c77-90dc-eecb897d9d19" status: 200 len: 1682 microversion: 2.1 time: 0.169533 Aug 04 05:28:42.090848 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 192/381] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:28:41 2022] GET /compute/v2.1/servers/b7dd37ec-81bf-4c77-90dc-eecb897d9d19 => generated 1682 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:28:42.523147 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-9f77756b-726d-4512-8aaf-97c15225036c tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:28:42.524216 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-9f77756b-726d-4512-8aaf-97c15225036c tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] [instance: 9333850c-071c-4330-98b9-84232a752ffe] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:28:42.532022 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-9f77756b-726d-4512-8aaf-97c15225036c tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:28:42.532938 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-9f77756b-726d-4512-8aaf-97c15225036c tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:28:42.533819 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-9f77756b-726d-4512-8aaf-97c15225036c tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:28:42.534344 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-9f77756b-726d-4512-8aaf-97c15225036c tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:28:42.792131 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-9f77756b-726d-4512-8aaf-97c15225036c tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb4dea95659c473b9b193c6234186430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1ca4b83dc874bda9f33e06f4910608c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:28:42.800996 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-9f77756b-726d-4512-8aaf-97c15225036c tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] 10.222.0.46 "GET /compute/v2.1/servers/9333850c-071c-4330-98b9-84232a752ffe" status: 200 len: 1723 microversion: 2.1 time: 0.284988 Aug 04 05:28:42.814337 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 190/382] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:28:42 2022] GET /compute/v2.1/servers/9333850c-071c-4330-98b9-84232a752ffe => generated 1723 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:28:43.110356 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-9b59e78b-c794-479e-816c-3fed4d5e8fdc tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:28:43.111234 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-9b59e78b-c794-479e-816c-3fed4d5e8fdc tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] [instance: b7dd37ec-81bf-4c77-90dc-eecb897d9d19] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:28:43.118403 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-9b59e78b-c794-479e-816c-3fed4d5e8fdc tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:28:43.119020 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-9b59e78b-c794-479e-816c-3fed4d5e8fdc tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:28:43.120461 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-9b59e78b-c794-479e-816c-3fed4d5e8fdc tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:28:43.121116 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-9b59e78b-c794-479e-816c-3fed4d5e8fdc tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:28:43.284713 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-9b59e78b-c794-479e-816c-3fed4d5e8fdc tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb49b631c234f9a9fd47049b9b2e097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faead990837d43de8ec54bfaf24361de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:28:43.293559 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-9b59e78b-c794-479e-816c-3fed4d5e8fdc tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] 10.222.0.46 "GET /compute/v2.1/servers/b7dd37ec-81bf-4c77-90dc-eecb897d9d19" status: 200 len: 1682 microversion: 2.1 time: 0.187342 Aug 04 05:28:43.306523 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 193/383] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:28:43 2022] GET /compute/v2.1/servers/b7dd37ec-81bf-4c77-90dc-eecb897d9d19 => generated 1682 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:28:43.699051 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [req-4b846eb0-9169-4fdb-86ea-f9e4c11dad5a req-0c5eb9c8-06ac-4bc5-9ddf-095f07a38594 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7dd37ec-81bf-4c77-90dc-eecb897d9d19", "name": "network-vif-deleted", "tag": "6eecea9c-0ed5-43c6-ad5e-85403bfef11c"}]} {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:28:43.723304 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [req-4b846eb0-9169-4fdb-86ea-f9e4c11dad5a req-0c5eb9c8-06ac-4bc5-9ddf-095f07a38594 service nova] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:28:43.723951 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [req-4b846eb0-9169-4fdb-86ea-f9e4c11dad5a req-0c5eb9c8-06ac-4bc5-9ddf-095f07a38594 service nova] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:28:43.746579 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.compute.server_external_events [req-4b846eb0-9169-4fdb-86ea-f9e4c11dad5a req-0c5eb9c8-06ac-4bc5-9ddf-095f07a38594 service nova] Creating event network-vif-deleted:6eecea9c-0ed5-43c6-ad5e-85403bfef11c for instance b7dd37ec-81bf-4c77-90dc-eecb897d9d19 on hv-cinder-85207 Aug 04 05:28:43.751733 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [req-4b846eb0-9169-4fdb-86ea-f9e4c11dad5a req-0c5eb9c8-06ac-4bc5-9ddf-095f07a38594 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057010 Aug 04 05:28:43.752767 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 191/384] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Aug 4 05:28:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 05:28:43.834465 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-5a4a9082-baf4-4d5c-be64-9462bccd8c99 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:28:43.835198 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-5a4a9082-baf4-4d5c-be64-9462bccd8c99 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] [instance: 9333850c-071c-4330-98b9-84232a752ffe] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:28:43.849020 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-5a4a9082-baf4-4d5c-be64-9462bccd8c99 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:28:43.849569 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-5a4a9082-baf4-4d5c-be64-9462bccd8c99 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:28:43.850463 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-5a4a9082-baf4-4d5c-be64-9462bccd8c99 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:28:43.851267 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-5a4a9082-baf4-4d5c-be64-9462bccd8c99 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:28:44.015568 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-5a4a9082-baf4-4d5c-be64-9462bccd8c99 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb4dea95659c473b9b193c6234186430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1ca4b83dc874bda9f33e06f4910608c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:28:44.028202 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-5a4a9082-baf4-4d5c-be64-9462bccd8c99 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] 10.222.0.46 "GET /compute/v2.1/servers/9333850c-071c-4330-98b9-84232a752ffe" status: 200 len: 1723 microversion: 2.1 time: 0.206553 Aug 04 05:28:44.030657 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 194/385] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:28:43 2022] GET /compute/v2.1/servers/9333850c-071c-4330-98b9-84232a752ffe => generated 1723 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:28:44.318023 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-288a434f-a07f-4571-a1fc-5eb05dab6de0 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:28:44.319027 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-288a434f-a07f-4571-a1fc-5eb05dab6de0 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] [instance: b7dd37ec-81bf-4c77-90dc-eecb897d9d19] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:28:44.332066 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-288a434f-a07f-4571-a1fc-5eb05dab6de0 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:28:44.332527 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-288a434f-a07f-4571-a1fc-5eb05dab6de0 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:28:44.333316 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-288a434f-a07f-4571-a1fc-5eb05dab6de0 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:28:44.333753 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-288a434f-a07f-4571-a1fc-5eb05dab6de0 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:28:44.417325 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-288a434f-a07f-4571-a1fc-5eb05dab6de0 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:28:44.417898 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-288a434f-a07f-4571-a1fc-5eb05dab6de0 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:28:44.418619 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.objects.instance [None req-288a434f-a07f-4571-a1fc-5eb05dab6de0 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lazy-loading 'fault' on Instance uuid b7dd37ec-81bf-4c77-90dc-eecb897d9d19 {{(pid=118476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 05:28:44.465280 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-288a434f-a07f-4571-a1fc-5eb05dab6de0 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb49b631c234f9a9fd47049b9b2e097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faead990837d43de8ec54bfaf24361de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:28:44.475434 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-288a434f-a07f-4571-a1fc-5eb05dab6de0 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] 10.222.0.46 "GET /compute/v2.1/servers/b7dd37ec-81bf-4c77-90dc-eecb897d9d19" status: 200 len: 1331 microversion: 2.1 time: 0.162296 Aug 04 05:28:44.476414 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 192/386] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:28:44 2022] GET /compute/v2.1/servers/b7dd37ec-81bf-4c77-90dc-eecb897d9d19 => generated 1331 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:28:45.063245 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-6320df43-efaf-4336-b935-cca831a17784 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:28:45.065225 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-6320df43-efaf-4336-b935-cca831a17784 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] [instance: 9333850c-071c-4330-98b9-84232a752ffe] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:28:45.079006 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-6320df43-efaf-4336-b935-cca831a17784 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:28:45.079006 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-6320df43-efaf-4336-b935-cca831a17784 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:28:45.079006 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-6320df43-efaf-4336-b935-cca831a17784 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:28:45.079006 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-6320df43-efaf-4336-b935-cca831a17784 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:28:45.155229 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-ccd72207-b47c-415e-b4a4-3e3867a5a1d2 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "76829b8a-2bf6-4ac0-9484-92fae22049e3"}} {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:28:45.157860 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-ccd72207-b47c-415e-b4a4-3e3867a5a1d2 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] [instance: 178b675e-f4d0-442c-aa69-aece6ea3d636] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:28:45.170146 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-ccd72207-b47c-415e-b4a4-3e3867a5a1d2 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:28:45.171321 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-ccd72207-b47c-415e-b4a4-3e3867a5a1d2 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:28:45.172387 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-ccd72207-b47c-415e-b4a4-3e3867a5a1d2 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:28:45.172979 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-ccd72207-b47c-415e-b4a4-3e3867a5a1d2 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:28:45.266567 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-6320df43-efaf-4336-b935-cca831a17784 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb4dea95659c473b9b193c6234186430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1ca4b83dc874bda9f33e06f4910608c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:28:45.279630 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-6320df43-efaf-4336-b935-cca831a17784 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] 10.222.0.46 "GET /compute/v2.1/servers/9333850c-071c-4330-98b9-84232a752ffe" status: 200 len: 1723 microversion: 2.1 time: 0.231574 Aug 04 05:28:45.280238 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 195/387] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:28:45 2022] GET /compute/v2.1/servers/9333850c-071c-4330-98b9-84232a752ffe => generated 1723 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:28:45.501442 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-f891b248-5119-47bb-8fc7-accac79f969e tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:28:45.502241 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-f891b248-5119-47bb-8fc7-accac79f969e tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] [instance: b7dd37ec-81bf-4c77-90dc-eecb897d9d19] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:28:45.508670 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-f891b248-5119-47bb-8fc7-accac79f969e tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:28:45.509900 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-f891b248-5119-47bb-8fc7-accac79f969e tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:28:45.510820 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-f891b248-5119-47bb-8fc7-accac79f969e tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:28:45.511290 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-f891b248-5119-47bb-8fc7-accac79f969e tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:28:45.535046 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.wsgi [None req-f891b248-5119-47bb-8fc7-accac79f969e tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] HTTP exception thrown: Instance b7dd37ec-81bf-4c77-90dc-eecb897d9d19 could not be found. Aug 04 05:28:45.536562 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-f891b248-5119-47bb-8fc7-accac79f969e tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Request method failure captured: Aug 04 05:28:45.536562 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: request: GET /compute/v2.1/servers/b7dd37ec-81bf-4c77-90dc-eecb897d9d19 HTTP/1.1 Aug 04 05:28:45.536562 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: Accept: application/json Aug 04 05:28:45.536562 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: Accept-Encoding: identity Aug 04 05:28:45.536562 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: Connection: close Aug 04 05:28:45.536562 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: Content-Length: 0 Aug 04 05:28:45.536562 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: Content-Type: application/json Aug 04 05:28:45.536562 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: Host: 10.222.0.46 Aug 04 05:28:45.536562 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: Openstack-System-Scope: None Aug 04 05:28:45.536562 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: User-Agent: python-urllib3/1.26.11 Aug 04 05:28:45.536562 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Auth-Token: gAAAAABi61g0x_8sFigG1jfXTOdqOMY1_3lK7UxaN3VmL5lqQXtIkCz4pWJYdYey2zGuiTigaV5gr0UWhaKZvxst4Kz-KOaAO64aM30ubWqVQfLIrJqf-RP6LF-c0ZabM-LUcJmxEmCuhHsUTEzNbVJn1WT0ja1hpuQC9pVY6l0Uzp1TYNzYyh0 Aug 04 05:28:45.536562 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Domain-Id: None Aug 04 05:28:45.536562 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Domain-Name: None Aug 04 05:28:45.536562 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Identity-Status: Confirmed Aug 04 05:28:45.536562 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Is-Admin-Project: True Aug 04 05:28:45.536562 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Project-Domain-Id: default Aug 04 05:28:45.536562 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Project-Domain-Name: Default Aug 04 05:28:45.536562 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Project-Id: faead990837d43de8ec54bfaf24361de Aug 04 05:28:45.536562 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Project-Name: tempest-AttachVolumeNegativeTest-710656709 Aug 04 05:28:45.536562 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Role: member,reader Aug 04 05:28:45.536562 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Roles: member,reader Aug 04 05:28:45.538183 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/faead990837d43de8ec54bfaf24361de"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/faead990837d43de8ec54bfaf24361de"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_faead990837d43de8ec54bfaf24361de", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/faead990837d43de8ec54bfaf24361de"}]}] Aug 04 05:28:45.538183 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Tenant: tempest-AttachVolumeNegativeTest-710656709 Aug 04 05:28:45.538183 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Tenant-Id: faead990837d43de8ec54bfaf24361de Aug 04 05:28:45.538183 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-710656709 Aug 04 05:28:45.538183 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-User: tempest-AttachVolumeNegativeTest-710656709-project Aug 04 05:28:45.538183 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-User-Domain-Id: default Aug 04 05:28:45.538183 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-User-Domain-Name: Default Aug 04 05:28:45.538183 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-User-Id: 9cb49b631c234f9a9fd47049b9b2e097 Aug 04 05:28:45.538183 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-User-Name: tempest-AttachVolumeNegativeTest-710656709-project Aug 04 05:28:45.538183 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: method: > Aug 04 05:28:45.538183 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: exception: Instance b7dd37ec-81bf-4c77-90dc-eecb897d9d19 could not be found. Aug 04 05:28:45.538183 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: action_args: {'id': 'b7dd37ec-81bf-4c77-90dc-eecb897d9d19'} Aug 04 05:28:45.539087 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 05:28:45.539087 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:28:45.539087 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 05:28:45.539087 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 05:28:45.539087 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 05:28:45.539087 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 05:28:45.539087 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 05:28:45.539087 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 05:28:45.539087 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 05:28:45.539087 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 05:28:45.539087 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b7dd37ec-81bf-4c77-90dc-eecb897d9d19 could not be found. Aug 04 05:28:45.539087 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Aug 04 05:28:45.539087 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:28:45.539087 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Aug 04 05:28:45.539087 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:28:45.539087 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:28:45.539087 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:28:45.539087 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 05:28:45.539087 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 05:28:45.539087 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 05:28:45.541413 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 05:28:45.541413 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 05:28:45.541413 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 05:28:45.541413 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 05:28:45.541413 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 05:28:45.541413 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 05:28:45.541413 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 05:28:45.541413 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b7dd37ec-81bf-4c77-90dc-eecb897d9d19 could not be found. Aug 04 05:28:45.541413 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Aug 04 05:28:45.541413 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:28:45.541413 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Aug 04 05:28:45.541413 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:28:45.541413 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:28:45.541413 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:28:45.541413 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 05:28:45.541413 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 05:28:45.541413 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b7dd37ec-81bf-4c77-90dc-eecb897d9d19 could not be found. Aug 04 05:28:45.541413 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Aug 04 05:28:45.544284 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-f891b248-5119-47bb-8fc7-accac79f969e tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Returning 404 to user: Instance b7dd37ec-81bf-4c77-90dc-eecb897d9d19 could not be found. {{(pid=118477) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 05:28:45.545265 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-f891b248-5119-47bb-8fc7-accac79f969e tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] 10.222.0.46 "GET /compute/v2.1/servers/b7dd37ec-81bf-4c77-90dc-eecb897d9d19" status: 404 len: 111 microversion: 2.1 time: 0.051543 Aug 04 05:28:45.545829 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 196/388] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:28:45 2022] GET /compute/v2.1/servers/b7dd37ec-81bf-4c77-90dc-eecb897d9d19 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 05:28:45.555244 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-eeafc4ff-027f-43f0-b046-dcb89c19d095 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Calling method '.version_select at 0x7f14759dc5e0>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:28:45.639238 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-eeafc4ff-027f-43f0-b046-dcb89c19d095 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1764646286" status: 202 len: 0 microversion: 2.1 time: 0.087610 Aug 04 05:28:45.641055 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 197/389] 10.222.0.46 () {58 vars in 1221 bytes} [Thu Aug 4 05:28:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1764646286 => generated 0 bytes in 90 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 05:28:46.053145 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-ccd72207-b47c-415e-b4a4-3e3867a5a1d2 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] 10.222.0.46 "POST /compute/v2.1/servers/178b675e-f4d0-442c-aa69-aece6ea3d636/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.901661 Aug 04 05:28:46.078834 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 193/390] 10.222.0.46 () {60 vars in 1323 bytes} [Thu Aug 4 05:28:45 2022] POST /compute/v2.1/servers/178b675e-f4d0-442c-aa69-aece6ea3d636/os-volume_attachments => generated 194 bytes in 906 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 05:28:46.303101 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-a181676b-cc7c-4f8f-9a6c-aa5b59a515db tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:28:46.304919 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-a181676b-cc7c-4f8f-9a6c-aa5b59a515db tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] [instance: 9333850c-071c-4330-98b9-84232a752ffe] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:28:46.315539 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-a181676b-cc7c-4f8f-9a6c-aa5b59a515db tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:28:46.316158 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-a181676b-cc7c-4f8f-9a6c-aa5b59a515db tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:28:46.317147 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-a181676b-cc7c-4f8f-9a6c-aa5b59a515db tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:28:46.317805 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-a181676b-cc7c-4f8f-9a6c-aa5b59a515db tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:28:46.516902 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-a181676b-cc7c-4f8f-9a6c-aa5b59a515db tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb4dea95659c473b9b193c6234186430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1ca4b83dc874bda9f33e06f4910608c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:28:46.525375 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-a181676b-cc7c-4f8f-9a6c-aa5b59a515db tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] 10.222.0.46 "GET /compute/v2.1/servers/9333850c-071c-4330-98b9-84232a752ffe" status: 200 len: 1723 microversion: 2.1 time: 0.226372 Aug 04 05:28:46.526379 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 198/391] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:28:46 2022] GET /compute/v2.1/servers/9333850c-071c-4330-98b9-84232a752ffe => generated 1723 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:28:47.071085 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-cc57a930-66ea-4aa2-89ee-674e7663c291 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:28:47.071675 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-cc57a930-66ea-4aa2-89ee-674e7663c291 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] [instance: 384721d7-1467-45cd-af93-eb458115f75e] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:28:47.078143 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-cc57a930-66ea-4aa2-89ee-674e7663c291 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:28:47.078635 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-cc57a930-66ea-4aa2-89ee-674e7663c291 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:28:47.079420 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-cc57a930-66ea-4aa2-89ee-674e7663c291 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:28:47.079860 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-cc57a930-66ea-4aa2-89ee-674e7663c291 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:28:47.215834 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.objects.instance [None req-cc57a930-66ea-4aa2-89ee-674e7663c291 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lazy-loading 'services' on Instance uuid 384721d7-1467-45cd-af93-eb458115f75e {{(pid=118476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 05:28:47.504636 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-cc57a930-66ea-4aa2-89ee-674e7663c291 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] 10.222.0.46 "DELETE /compute/v2.1/servers/384721d7-1467-45cd-af93-eb458115f75e/os-volume_attachments/2df06300-47c9-4304-818b-31a0903cd559" status: 202 len: 0 microversion: 2.1 time: 0.438181 Aug 04 05:28:47.505233 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 194/392] 10.222.0.46 () {58 vars in 1416 bytes} [Thu Aug 4 05:28:47 2022] DELETE /compute/v2.1/servers/384721d7-1467-45cd-af93-eb458115f75e/os-volume_attachments/2df06300-47c9-4304-818b-31a0903cd559 => generated 0 bytes in 440 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 05:28:47.515156 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-75e9c184-abde-46a6-8052-9796d213eeac tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:28:47.517650 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-75e9c184-abde-46a6-8052-9796d213eeac tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] [instance: 384721d7-1467-45cd-af93-eb458115f75e] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:28:47.532770 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-75e9c184-abde-46a6-8052-9796d213eeac tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:28:47.533279 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-75e9c184-abde-46a6-8052-9796d213eeac tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:28:47.533989 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-75e9c184-abde-46a6-8052-9796d213eeac tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:28:47.534520 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-75e9c184-abde-46a6-8052-9796d213eeac tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:28:47.549914 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-4ef4439d-29f6-4408-8ba6-0725c3260adb tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:28:47.551869 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-4ef4439d-29f6-4408-8ba6-0725c3260adb tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] [instance: 9333850c-071c-4330-98b9-84232a752ffe] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:28:47.559265 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-4ef4439d-29f6-4408-8ba6-0725c3260adb tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:28:47.559860 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-4ef4439d-29f6-4408-8ba6-0725c3260adb tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:28:47.560643 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-4ef4439d-29f6-4408-8ba6-0725c3260adb tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:28:47.561082 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-4ef4439d-29f6-4408-8ba6-0725c3260adb tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:28:47.570395 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-75e9c184-abde-46a6-8052-9796d213eeac tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] 10.222.0.46 "GET /compute/v2.1/servers/384721d7-1467-45cd-af93-eb458115f75e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059717 Aug 04 05:28:47.571198 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 199/393] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Aug 4 05:28:47 2022] GET /compute/v2.1/servers/384721d7-1467-45cd-af93-eb458115f75e/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:28:47.713754 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-4ef4439d-29f6-4408-8ba6-0725c3260adb tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb4dea95659c473b9b193c6234186430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1ca4b83dc874bda9f33e06f4910608c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:28:47.722412 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-4ef4439d-29f6-4408-8ba6-0725c3260adb tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] 10.222.0.46 "GET /compute/v2.1/servers/9333850c-071c-4330-98b9-84232a752ffe" status: 200 len: 1723 microversion: 2.1 time: 0.178226 Aug 04 05:28:47.723007 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 195/394] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:28:47 2022] GET /compute/v2.1/servers/9333850c-071c-4330-98b9-84232a752ffe => generated 1723 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 05:28:48.583885 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-64f2be3a-da82-441e-9988-293b460bb734 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:28:48.586045 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-64f2be3a-da82-441e-9988-293b460bb734 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] [instance: 384721d7-1467-45cd-af93-eb458115f75e] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:28:48.593079 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-64f2be3a-da82-441e-9988-293b460bb734 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:28:48.593507 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-64f2be3a-da82-441e-9988-293b460bb734 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:28:48.594260 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-64f2be3a-da82-441e-9988-293b460bb734 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:28:48.594860 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-64f2be3a-da82-441e-9988-293b460bb734 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:28:48.625635 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-64f2be3a-da82-441e-9988-293b460bb734 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] 10.222.0.46 "GET /compute/v2.1/servers/384721d7-1467-45cd-af93-eb458115f75e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045746 Aug 04 05:28:48.626191 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 200/395] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Aug 4 05:28:48 2022] GET /compute/v2.1/servers/384721d7-1467-45cd-af93-eb458115f75e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 05:28:48.745285 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-8ea3e6b3-b3ee-4726-9eb2-a817f5610619 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:28:48.745890 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-8ea3e6b3-b3ee-4726-9eb2-a817f5610619 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] [instance: 9333850c-071c-4330-98b9-84232a752ffe] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:28:48.752822 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-8ea3e6b3-b3ee-4726-9eb2-a817f5610619 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:28:48.753269 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-8ea3e6b3-b3ee-4726-9eb2-a817f5610619 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:28:48.754040 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-8ea3e6b3-b3ee-4726-9eb2-a817f5610619 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:28:48.754514 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-8ea3e6b3-b3ee-4726-9eb2-a817f5610619 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:28:48.760626 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG dbcounter [-] [118476] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=4,nova_cell1:INSERT=4 {{(pid=118476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:28:48.896379 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-8ea3e6b3-b3ee-4726-9eb2-a817f5610619 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb4dea95659c473b9b193c6234186430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1ca4b83dc874bda9f33e06f4910608c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:28:48.905975 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-8ea3e6b3-b3ee-4726-9eb2-a817f5610619 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] 10.222.0.46 "GET /compute/v2.1/servers/9333850c-071c-4330-98b9-84232a752ffe" status: 200 len: 1723 microversion: 2.1 time: 0.164729 Aug 04 05:28:48.906631 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 196/396] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:28:48 2022] GET /compute/v2.1/servers/9333850c-071c-4330-98b9-84232a752ffe => generated 1723 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:28:49.639152 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-d3e93c75-4cff-4381-82e6-ded7f9c2e09e tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:28:49.641406 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-d3e93c75-4cff-4381-82e6-ded7f9c2e09e tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] [instance: 384721d7-1467-45cd-af93-eb458115f75e] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:28:49.647995 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-d3e93c75-4cff-4381-82e6-ded7f9c2e09e tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:28:49.648445 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-d3e93c75-4cff-4381-82e6-ded7f9c2e09e tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:28:49.649202 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-d3e93c75-4cff-4381-82e6-ded7f9c2e09e tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:28:49.650343 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-d3e93c75-4cff-4381-82e6-ded7f9c2e09e tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:28:49.682652 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-d3e93c75-4cff-4381-82e6-ded7f9c2e09e tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] 10.222.0.46 "GET /compute/v2.1/servers/384721d7-1467-45cd-af93-eb458115f75e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047498 Aug 04 05:28:49.683263 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 201/397] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Aug 4 05:28:49 2022] GET /compute/v2.1/servers/384721d7-1467-45cd-af93-eb458115f75e/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:28:49.927711 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-1457cf37-e8b7-49b2-996c-6784207ac17e tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:28:49.928253 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-1457cf37-e8b7-49b2-996c-6784207ac17e tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] [instance: 9333850c-071c-4330-98b9-84232a752ffe] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:28:49.935904 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-1457cf37-e8b7-49b2-996c-6784207ac17e tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:28:49.936344 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-1457cf37-e8b7-49b2-996c-6784207ac17e tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:28:49.937105 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-1457cf37-e8b7-49b2-996c-6784207ac17e tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:28:49.937590 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-1457cf37-e8b7-49b2-996c-6784207ac17e tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:28:50.073010 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-1457cf37-e8b7-49b2-996c-6784207ac17e tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb4dea95659c473b9b193c6234186430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1ca4b83dc874bda9f33e06f4910608c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:28:50.081191 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-1457cf37-e8b7-49b2-996c-6784207ac17e tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] 10.222.0.46 "GET /compute/v2.1/servers/9333850c-071c-4330-98b9-84232a752ffe" status: 200 len: 1700 microversion: 2.1 time: 0.157625 Aug 04 05:28:50.081758 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 197/398] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:28:49 2022] GET /compute/v2.1/servers/9333850c-071c-4330-98b9-84232a752ffe => generated 1700 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 05:28:50.102682 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-a9c74be9-348b-4b57-9db4-a55037a5d1da tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:28:50.109737 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-a9c74be9-348b-4b57-9db4-a55037a5d1da tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:28:50.110174 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-a9c74be9-348b-4b57-9db4-a55037a5d1da tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:28:50.171114 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-a9c74be9-348b-4b57-9db4-a55037a5d1da tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] [instance: 9333850c-071c-4330-98b9-84232a752ffe] Going to try to start instance {{(pid=118477) start /opt/stack/nova/nova/compute/api.py:2732}} Aug 04 05:28:50.360439 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-a9c74be9-348b-4b57-9db4-a55037a5d1da tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] 10.222.0.46 "POST /compute/v2.1/servers/9333850c-071c-4330-98b9-84232a752ffe/action" status: 202 len: 0 microversion: 2.1 time: 0.261358 Aug 04 05:28:50.361089 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 202/399] 10.222.0.46 () {60 vars in 1278 bytes} [Thu Aug 4 05:28:50 2022] POST /compute/v2.1/servers/9333850c-071c-4330-98b9-84232a752ffe/action => generated 0 bytes in 263 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 05:28:50.370081 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-f6bbdd00-3a9d-4c2f-a34e-0d4d14906242 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:28:50.370748 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-f6bbdd00-3a9d-4c2f-a34e-0d4d14906242 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] [instance: 9333850c-071c-4330-98b9-84232a752ffe] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:28:50.377162 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-f6bbdd00-3a9d-4c2f-a34e-0d4d14906242 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:28:50.377454 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-f6bbdd00-3a9d-4c2f-a34e-0d4d14906242 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:28:50.378382 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-f6bbdd00-3a9d-4c2f-a34e-0d4d14906242 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:28:50.378817 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-f6bbdd00-3a9d-4c2f-a34e-0d4d14906242 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:28:50.519980 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-f6bbdd00-3a9d-4c2f-a34e-0d4d14906242 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb4dea95659c473b9b193c6234186430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1ca4b83dc874bda9f33e06f4910608c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:28:50.528151 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-f6bbdd00-3a9d-4c2f-a34e-0d4d14906242 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] 10.222.0.46 "GET /compute/v2.1/servers/9333850c-071c-4330-98b9-84232a752ffe" status: 200 len: 1709 microversion: 2.1 time: 0.162537 Aug 04 05:28:50.529430 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 198/400] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:28:50 2022] GET /compute/v2.1/servers/9333850c-071c-4330-98b9-84232a752ffe => generated 1709 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:28:50.696260 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-56c21aa3-0dbc-4cc6-8205-5b07ce90b397 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:28:50.699769 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-56c21aa3-0dbc-4cc6-8205-5b07ce90b397 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] [instance: 384721d7-1467-45cd-af93-eb458115f75e] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:28:50.706924 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-56c21aa3-0dbc-4cc6-8205-5b07ce90b397 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:28:50.707546 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-56c21aa3-0dbc-4cc6-8205-5b07ce90b397 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:28:50.708504 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-56c21aa3-0dbc-4cc6-8205-5b07ce90b397 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:28:50.708953 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-56c21aa3-0dbc-4cc6-8205-5b07ce90b397 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:28:50.728129 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG dbcounter [-] [118477] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:28:50.745835 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-56c21aa3-0dbc-4cc6-8205-5b07ce90b397 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] 10.222.0.46 "GET /compute/v2.1/servers/384721d7-1467-45cd-af93-eb458115f75e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054250 Aug 04 05:28:50.746622 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 203/401] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Aug 4 05:28:50 2022] GET /compute/v2.1/servers/384721d7-1467-45cd-af93-eb458115f75e/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:28:51.555300 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-5a2cdf50-3673-447e-b312-dafb9edbc09c tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:28:51.556046 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-5a2cdf50-3673-447e-b312-dafb9edbc09c tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] [instance: 9333850c-071c-4330-98b9-84232a752ffe] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:28:51.562903 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-5a2cdf50-3673-447e-b312-dafb9edbc09c tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:28:51.564553 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-5a2cdf50-3673-447e-b312-dafb9edbc09c tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:28:51.565892 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-5a2cdf50-3673-447e-b312-dafb9edbc09c tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:28:51.566689 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-5a2cdf50-3673-447e-b312-dafb9edbc09c tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:28:51.718134 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-5a2cdf50-3673-447e-b312-dafb9edbc09c tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb4dea95659c473b9b193c6234186430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1ca4b83dc874bda9f33e06f4910608c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:28:51.729264 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-5a2cdf50-3673-447e-b312-dafb9edbc09c tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] 10.222.0.46 "GET /compute/v2.1/servers/9333850c-071c-4330-98b9-84232a752ffe" status: 200 len: 1709 microversion: 2.1 time: 0.179701 Aug 04 05:28:51.729846 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 199/402] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:28:51 2022] GET /compute/v2.1/servers/9333850c-071c-4330-98b9-84232a752ffe => generated 1709 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 05:28:51.762564 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-33ac025c-e3c4-4630-be04-1451ea49353f tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:28:51.764849 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-33ac025c-e3c4-4630-be04-1451ea49353f tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] [instance: 384721d7-1467-45cd-af93-eb458115f75e] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:28:51.772106 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-33ac025c-e3c4-4630-be04-1451ea49353f tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:28:51.772560 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-33ac025c-e3c4-4630-be04-1451ea49353f tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:28:51.773331 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-33ac025c-e3c4-4630-be04-1451ea49353f tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:28:51.773765 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-33ac025c-e3c4-4630-be04-1451ea49353f tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:28:51.805052 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-33ac025c-e3c4-4630-be04-1451ea49353f tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] 10.222.0.46 "GET /compute/v2.1/servers/384721d7-1467-45cd-af93-eb458115f75e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047756 Aug 04 05:28:51.805651 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 204/403] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Aug 4 05:28:51 2022] GET /compute/v2.1/servers/384721d7-1467-45cd-af93-eb458115f75e/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:28:52.751470 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-398bc4cf-f8bd-4401-9cac-0dc3def37756 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:28:52.752082 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-398bc4cf-f8bd-4401-9cac-0dc3def37756 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] [instance: 9333850c-071c-4330-98b9-84232a752ffe] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:28:52.760164 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-398bc4cf-f8bd-4401-9cac-0dc3def37756 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:28:52.761155 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-398bc4cf-f8bd-4401-9cac-0dc3def37756 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:28:52.761627 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-398bc4cf-f8bd-4401-9cac-0dc3def37756 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:28:52.762097 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-398bc4cf-f8bd-4401-9cac-0dc3def37756 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:28:52.818206 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-e9ceb6d1-edba-43a8-8c1c-13a4337a0154 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:28:52.820136 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-e9ceb6d1-edba-43a8-8c1c-13a4337a0154 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] [instance: 384721d7-1467-45cd-af93-eb458115f75e] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:28:52.827956 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-e9ceb6d1-edba-43a8-8c1c-13a4337a0154 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:28:52.828550 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-e9ceb6d1-edba-43a8-8c1c-13a4337a0154 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:28:52.829177 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-e9ceb6d1-edba-43a8-8c1c-13a4337a0154 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:28:52.829613 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-e9ceb6d1-edba-43a8-8c1c-13a4337a0154 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:28:52.861484 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-e9ceb6d1-edba-43a8-8c1c-13a4337a0154 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] 10.222.0.46 "GET /compute/v2.1/servers/384721d7-1467-45cd-af93-eb458115f75e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047824 Aug 04 05:28:52.862136 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 205/404] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Aug 4 05:28:52 2022] GET /compute/v2.1/servers/384721d7-1467-45cd-af93-eb458115f75e/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 05:28:52.913765 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-398bc4cf-f8bd-4401-9cac-0dc3def37756 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb4dea95659c473b9b193c6234186430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1ca4b83dc874bda9f33e06f4910608c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:28:52.925249 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-398bc4cf-f8bd-4401-9cac-0dc3def37756 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] 10.222.0.46 "GET /compute/v2.1/servers/9333850c-071c-4330-98b9-84232a752ffe" status: 200 len: 1709 microversion: 2.1 time: 0.177978 Aug 04 05:28:52.925851 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 200/405] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:28:52 2022] GET /compute/v2.1/servers/9333850c-071c-4330-98b9-84232a752ffe => generated 1709 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 05:28:53.876480 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-1ca4ae93-7432-4843-8b2e-3634d50f1097 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:28:53.879406 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-1ca4ae93-7432-4843-8b2e-3634d50f1097 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] [instance: 384721d7-1467-45cd-af93-eb458115f75e] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:28:53.888383 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-1ca4ae93-7432-4843-8b2e-3634d50f1097 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:28:53.888826 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-1ca4ae93-7432-4843-8b2e-3634d50f1097 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:28:53.890028 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-1ca4ae93-7432-4843-8b2e-3634d50f1097 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:28:53.890631 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-1ca4ae93-7432-4843-8b2e-3634d50f1097 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:28:53.921457 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-1ca4ae93-7432-4843-8b2e-3634d50f1097 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] 10.222.0.46 "GET /compute/v2.1/servers/384721d7-1467-45cd-af93-eb458115f75e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051384 Aug 04 05:28:53.922267 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 206/406] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Aug 4 05:28:53 2022] GET /compute/v2.1/servers/384721d7-1467-45cd-af93-eb458115f75e/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:28:53.949362 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-d2f0a67e-498d-4c6e-9abf-2cd1f0783c7b tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:28:53.950219 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-d2f0a67e-498d-4c6e-9abf-2cd1f0783c7b tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] [instance: 9333850c-071c-4330-98b9-84232a752ffe] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:28:53.957215 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-d2f0a67e-498d-4c6e-9abf-2cd1f0783c7b tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:28:53.957666 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-d2f0a67e-498d-4c6e-9abf-2cd1f0783c7b tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:28:53.958512 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-d2f0a67e-498d-4c6e-9abf-2cd1f0783c7b tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:28:53.958969 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-d2f0a67e-498d-4c6e-9abf-2cd1f0783c7b tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:28:54.103467 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-d2f0a67e-498d-4c6e-9abf-2cd1f0783c7b tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb4dea95659c473b9b193c6234186430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1ca4b83dc874bda9f33e06f4910608c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:28:54.111995 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-d2f0a67e-498d-4c6e-9abf-2cd1f0783c7b tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] 10.222.0.46 "GET /compute/v2.1/servers/9333850c-071c-4330-98b9-84232a752ffe" status: 200 len: 1713 microversion: 2.1 time: 0.167432 Aug 04 05:28:54.114572 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 201/407] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:28:53 2022] GET /compute/v2.1/servers/9333850c-071c-4330-98b9-84232a752ffe => generated 1713 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:28:54.763764 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-edb38c35-0cde-4694-b98f-dd8ae9e7e76b tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:28:54.765932 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-edb38c35-0cde-4694-b98f-dd8ae9e7e76b tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] [instance: 178b675e-f4d0-442c-aa69-aece6ea3d636] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:28:54.772446 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-edb38c35-0cde-4694-b98f-dd8ae9e7e76b tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:28:54.773008 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-edb38c35-0cde-4694-b98f-dd8ae9e7e76b tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:28:54.773501 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-edb38c35-0cde-4694-b98f-dd8ae9e7e76b tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:28:54.773871 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-edb38c35-0cde-4694-b98f-dd8ae9e7e76b tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:28:54.798484 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.objects.instance [None req-edb38c35-0cde-4694-b98f-dd8ae9e7e76b tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lazy-loading 'flavor' on Instance uuid 178b675e-f4d0-442c-aa69-aece6ea3d636 {{(pid=118477) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 05:28:54.934659 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-8cf3d9f8-02db-4840-9627-b00f4e17d965 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:28:54.937124 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-8cf3d9f8-02db-4840-9627-b00f4e17d965 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] [instance: 384721d7-1467-45cd-af93-eb458115f75e] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:28:54.943512 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-8cf3d9f8-02db-4840-9627-b00f4e17d965 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:28:54.943957 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-8cf3d9f8-02db-4840-9627-b00f4e17d965 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:28:54.944713 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-8cf3d9f8-02db-4840-9627-b00f4e17d965 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:28:54.945142 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-8cf3d9f8-02db-4840-9627-b00f4e17d965 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:28:54.979661 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-8cf3d9f8-02db-4840-9627-b00f4e17d965 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] 10.222.0.46 "GET /compute/v2.1/servers/384721d7-1467-45cd-af93-eb458115f75e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050207 Aug 04 05:28:54.981779 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 202/408] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Aug 4 05:28:54 2022] GET /compute/v2.1/servers/384721d7-1467-45cd-af93-eb458115f75e/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 05:28:55.185083 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-edb38c35-0cde-4694-b98f-dd8ae9e7e76b tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] 10.222.0.46 "POST /compute/v2.1/servers/178b675e-f4d0-442c-aa69-aece6ea3d636/action" status: 200 len: 32 microversion: 2.1 time: 0.425777 Aug 04 05:28:55.185721 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 207/409] 10.222.0.46 () {60 vars in 1278 bytes} [Thu Aug 4 05:28:54 2022] POST /compute/v2.1/servers/178b675e-f4d0-442c-aa69-aece6ea3d636/action => generated 32 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 05:28:55.195327 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-3d49feeb-9d03-4d6f-a640-f57d161b11e7 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:28:55.196023 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-3d49feeb-9d03-4d6f-a640-f57d161b11e7 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] [instance: 178b675e-f4d0-442c-aa69-aece6ea3d636] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:28:55.203007 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-3d49feeb-9d03-4d6f-a640-f57d161b11e7 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:28:55.203463 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-3d49feeb-9d03-4d6f-a640-f57d161b11e7 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:28:55.204212 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-3d49feeb-9d03-4d6f-a640-f57d161b11e7 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:28:55.204643 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-3d49feeb-9d03-4d6f-a640-f57d161b11e7 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:28:55.350514 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-3d49feeb-9d03-4d6f-a640-f57d161b11e7 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8f887f5689419e9e31a0ba43f76ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62d19c831574f9b99c993b5e41c645d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:28:55.363688 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-3d49feeb-9d03-4d6f-a640-f57d161b11e7 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] 10.222.0.46 "GET /compute/v2.1/servers/178b675e-f4d0-442c-aa69-aece6ea3d636" status: 200 len: 1736 microversion: 2.1 time: 0.171548 Aug 04 05:28:55.363688 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 203/410] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:28:55 2022] GET /compute/v2.1/servers/178b675e-f4d0-442c-aa69-aece6ea3d636 => generated 1736 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:28:55.992898 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-f34bf07b-98d1-44f1-b004-fdd56f1ede45 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:28:55.995412 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-f34bf07b-98d1-44f1-b004-fdd56f1ede45 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] [instance: 384721d7-1467-45cd-af93-eb458115f75e] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:28:56.002558 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-f34bf07b-98d1-44f1-b004-fdd56f1ede45 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:28:56.003794 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-f34bf07b-98d1-44f1-b004-fdd56f1ede45 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:28:56.005249 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-f34bf07b-98d1-44f1-b004-fdd56f1ede45 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:28:56.006288 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-f34bf07b-98d1-44f1-b004-fdd56f1ede45 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:28:56.044458 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-f34bf07b-98d1-44f1-b004-fdd56f1ede45 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] 10.222.0.46 "GET /compute/v2.1/servers/384721d7-1467-45cd-af93-eb458115f75e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.055879 Aug 04 05:28:56.044945 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 208/411] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Aug 4 05:28:55 2022] GET /compute/v2.1/servers/384721d7-1467-45cd-af93-eb458115f75e/os-volume_attachments => generated 25 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 05:28:56.112529 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-973dc8ae-680c-4713-9130-992ad1932ebb tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:28:56.113077 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-973dc8ae-680c-4713-9130-992ad1932ebb tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] [instance: 384721d7-1467-45cd-af93-eb458115f75e] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:28:56.120222 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-973dc8ae-680c-4713-9130-992ad1932ebb tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:28:56.120702 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-973dc8ae-680c-4713-9130-992ad1932ebb tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:28:56.121525 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-973dc8ae-680c-4713-9130-992ad1932ebb tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:28:56.122157 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-973dc8ae-680c-4713-9130-992ad1932ebb tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:28:56.150724 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-973dc8ae-680c-4713-9130-992ad1932ebb tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] [instance: 384721d7-1467-45cd-af93-eb458115f75e] Going to try to terminate instance {{(pid=118476) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 05:28:56.387089 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-81ce94eb-6dc1-4f2e-bab0-9dad66938033 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:28:56.387703 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-81ce94eb-6dc1-4f2e-bab0-9dad66938033 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] [instance: 178b675e-f4d0-442c-aa69-aece6ea3d636] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:28:56.394646 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-81ce94eb-6dc1-4f2e-bab0-9dad66938033 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:28:56.395080 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-81ce94eb-6dc1-4f2e-bab0-9dad66938033 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:28:56.395850 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-81ce94eb-6dc1-4f2e-bab0-9dad66938033 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:28:56.396272 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-81ce94eb-6dc1-4f2e-bab0-9dad66938033 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:28:56.403954 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-973dc8ae-680c-4713-9130-992ad1932ebb tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] 10.222.0.46 "DELETE /compute/v2.1/servers/384721d7-1467-45cd-af93-eb458115f75e" status: 204 len: 0 microversion: 2.1 time: 0.295309 Aug 04 05:28:56.404609 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 204/412] 10.222.0.46 () {58 vars in 1239 bytes} [Thu Aug 4 05:28:56 2022] DELETE /compute/v2.1/servers/384721d7-1467-45cd-af93-eb458115f75e => generated 0 bytes in 297 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 05:28:56.414238 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-2ad48006-cef8-431a-9db7-85ba5355a222 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:28:56.415092 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-2ad48006-cef8-431a-9db7-85ba5355a222 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] [instance: 384721d7-1467-45cd-af93-eb458115f75e] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:28:56.421752 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-2ad48006-cef8-431a-9db7-85ba5355a222 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:28:56.422286 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-2ad48006-cef8-431a-9db7-85ba5355a222 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:28:56.423164 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-2ad48006-cef8-431a-9db7-85ba5355a222 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:28:56.423674 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-2ad48006-cef8-431a-9db7-85ba5355a222 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:28:56.615829 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-81ce94eb-6dc1-4f2e-bab0-9dad66938033 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8f887f5689419e9e31a0ba43f76ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62d19c831574f9b99c993b5e41c645d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:28:56.625108 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-81ce94eb-6dc1-4f2e-bab0-9dad66938033 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] 10.222.0.46 "GET /compute/v2.1/servers/178b675e-f4d0-442c-aa69-aece6ea3d636" status: 200 len: 1736 microversion: 2.1 time: 0.242634 Aug 04 05:28:56.626140 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 209/413] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:28:56 2022] GET /compute/v2.1/servers/178b675e-f4d0-442c-aa69-aece6ea3d636 => generated 1736 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:28:56.629117 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-2ad48006-cef8-431a-9db7-85ba5355a222 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb49b631c234f9a9fd47049b9b2e097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faead990837d43de8ec54bfaf24361de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:28:56.639198 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-2ad48006-cef8-431a-9db7-85ba5355a222 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] 10.222.0.46 "GET /compute/v2.1/servers/384721d7-1467-45cd-af93-eb458115f75e" status: 200 len: 1680 microversion: 2.1 time: 0.228768 Aug 04 05:28:56.640417 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 205/414] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:28:56 2022] GET /compute/v2.1/servers/384721d7-1467-45cd-af93-eb458115f75e => generated 1680 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:28:57.647679 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-064dd337-93c1-48c4-ae23-535224337f76 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:28:57.648267 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-064dd337-93c1-48c4-ae23-535224337f76 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] [instance: 178b675e-f4d0-442c-aa69-aece6ea3d636] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:28:57.655004 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-064dd337-93c1-48c4-ae23-535224337f76 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:28:57.655451 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-064dd337-93c1-48c4-ae23-535224337f76 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:28:57.656312 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-064dd337-93c1-48c4-ae23-535224337f76 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:28:57.656744 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-064dd337-93c1-48c4-ae23-535224337f76 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:28:57.661798 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-9edfb9f8-8546-4afa-b2cf-642150737486 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:28:57.662434 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-9edfb9f8-8546-4afa-b2cf-642150737486 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] [instance: 384721d7-1467-45cd-af93-eb458115f75e] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:28:57.670097 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-9edfb9f8-8546-4afa-b2cf-642150737486 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:28:57.670635 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-9edfb9f8-8546-4afa-b2cf-642150737486 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:28:57.671304 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-9edfb9f8-8546-4afa-b2cf-642150737486 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:28:57.671734 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-9edfb9f8-8546-4afa-b2cf-642150737486 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:28:58.126059 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-064dd337-93c1-48c4-ae23-535224337f76 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8f887f5689419e9e31a0ba43f76ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62d19c831574f9b99c993b5e41c645d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:28:58.134301 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-064dd337-93c1-48c4-ae23-535224337f76 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] 10.222.0.46 "GET /compute/v2.1/servers/178b675e-f4d0-442c-aa69-aece6ea3d636" status: 200 len: 1736 microversion: 2.1 time: 0.490515 Aug 04 05:28:58.134903 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 210/415] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:28:57 2022] GET /compute/v2.1/servers/178b675e-f4d0-442c-aa69-aece6ea3d636 => generated 1736 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:28:58.140977 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-9edfb9f8-8546-4afa-b2cf-642150737486 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb49b631c234f9a9fd47049b9b2e097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faead990837d43de8ec54bfaf24361de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:28:58.148496 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-9edfb9f8-8546-4afa-b2cf-642150737486 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] 10.222.0.46 "GET /compute/v2.1/servers/384721d7-1467-45cd-af93-eb458115f75e" status: 200 len: 1680 microversion: 2.1 time: 0.491352 Aug 04 05:28:58.149065 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 206/416] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:28:57 2022] GET /compute/v2.1/servers/384721d7-1467-45cd-af93-eb458115f75e => generated 1680 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 05:28:59.163291 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-d232930a-5e0b-4295-8545-51560268f0c2 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:28:59.169883 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-d232930a-5e0b-4295-8545-51560268f0c2 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] [instance: 178b675e-f4d0-442c-aa69-aece6ea3d636] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:28:59.171289 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-52aaf297-2c4f-437d-9723-b9eca7fdd7f3 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:28:59.172430 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-52aaf297-2c4f-437d-9723-b9eca7fdd7f3 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] [instance: 384721d7-1467-45cd-af93-eb458115f75e] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:28:59.180434 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-52aaf297-2c4f-437d-9723-b9eca7fdd7f3 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:28:59.181130 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-52aaf297-2c4f-437d-9723-b9eca7fdd7f3 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:28:59.194427 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-52aaf297-2c4f-437d-9723-b9eca7fdd7f3 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:28:59.194427 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-52aaf297-2c4f-437d-9723-b9eca7fdd7f3 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:28:59.194637 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-d232930a-5e0b-4295-8545-51560268f0c2 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:28:59.194637 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-d232930a-5e0b-4295-8545-51560268f0c2 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:28:59.194637 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-d232930a-5e0b-4295-8545-51560268f0c2 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:28:59.194637 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-d232930a-5e0b-4295-8545-51560268f0c2 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:28:59.278549 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-52aaf297-2c4f-437d-9723-b9eca7fdd7f3 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb49b631c234f9a9fd47049b9b2e097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faead990837d43de8ec54bfaf24361de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:28:59.287431 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-52aaf297-2c4f-437d-9723-b9eca7fdd7f3 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] 10.222.0.46 "GET /compute/v2.1/servers/384721d7-1467-45cd-af93-eb458115f75e" status: 200 len: 1612 microversion: 2.1 time: 0.119910 Aug 04 05:28:59.288017 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 207/417] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:28:59 2022] GET /compute/v2.1/servers/384721d7-1467-45cd-af93-eb458115f75e => generated 1612 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:28:59.426123 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-d232930a-5e0b-4295-8545-51560268f0c2 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8f887f5689419e9e31a0ba43f76ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62d19c831574f9b99c993b5e41c645d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:28:59.436310 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-d232930a-5e0b-4295-8545-51560268f0c2 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] 10.222.0.46 "GET /compute/v2.1/servers/178b675e-f4d0-442c-aa69-aece6ea3d636" status: 200 len: 1736 microversion: 2.1 time: 0.280691 Aug 04 05:28:59.436893 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 211/418] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:28:59 2022] GET /compute/v2.1/servers/178b675e-f4d0-442c-aa69-aece6ea3d636 => generated 1736 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:28:59.595177 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [req-b3cfa41c-8909-4824-8d3f-c1ca9c594ae2 req-97198dc1-957b-4fee-836e-0f4074427662 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "384721d7-1467-45cd-af93-eb458115f75e", "name": "network-vif-deleted", "tag": "7d9439ea-7e8f-45ca-beda-13020209ac61"}]} {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:28:59.606029 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [req-b3cfa41c-8909-4824-8d3f-c1ca9c594ae2 req-97198dc1-957b-4fee-836e-0f4074427662 service nova] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:28:59.606547 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [req-b3cfa41c-8909-4824-8d3f-c1ca9c594ae2 req-97198dc1-957b-4fee-836e-0f4074427662 service nova] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:28:59.618951 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.compute.server_external_events [req-b3cfa41c-8909-4824-8d3f-c1ca9c594ae2 req-97198dc1-957b-4fee-836e-0f4074427662 service nova] Creating event network-vif-deleted:7d9439ea-7e8f-45ca-beda-13020209ac61 for instance 384721d7-1467-45cd-af93-eb458115f75e on hv-cinder-85207 Aug 04 05:28:59.625027 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [req-b3cfa41c-8909-4824-8d3f-c1ca9c594ae2 req-97198dc1-957b-4fee-836e-0f4074427662 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033549 Aug 04 05:28:59.625964 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 208/419] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Aug 4 05:28:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:29:00.309888 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-964b327a-8181-43e5-afac-980e8db5d60f tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:29:00.310523 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-964b327a-8181-43e5-afac-980e8db5d60f tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] [instance: 384721d7-1467-45cd-af93-eb458115f75e] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:29:00.316994 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-964b327a-8181-43e5-afac-980e8db5d60f tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:29:00.317434 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-964b327a-8181-43e5-afac-980e8db5d60f tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:29:00.318185 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-964b327a-8181-43e5-afac-980e8db5d60f tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:29:00.318638 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-964b327a-8181-43e5-afac-980e8db5d60f tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:29:00.349954 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-964b327a-8181-43e5-afac-980e8db5d60f tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:29:00.350427 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-964b327a-8181-43e5-afac-980e8db5d60f tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:29:00.350871 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.objects.instance [None req-964b327a-8181-43e5-afac-980e8db5d60f tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lazy-loading 'fault' on Instance uuid 384721d7-1467-45cd-af93-eb458115f75e {{(pid=118477) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 05:29:00.394715 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-964b327a-8181-43e5-afac-980e8db5d60f tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb49b631c234f9a9fd47049b9b2e097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faead990837d43de8ec54bfaf24361de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:29:00.403290 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-964b327a-8181-43e5-afac-980e8db5d60f tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] 10.222.0.46 "GET /compute/v2.1/servers/384721d7-1467-45cd-af93-eb458115f75e" status: 200 len: 1330 microversion: 2.1 time: 0.098529 Aug 04 05:29:00.403870 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 212/420] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:29:00 2022] GET /compute/v2.1/servers/384721d7-1467-45cd-af93-eb458115f75e => generated 1330 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:29:00.458795 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-ca7f685c-3ab5-44f8-8e27-a217e2e8ee06 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:29:00.459508 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-ca7f685c-3ab5-44f8-8e27-a217e2e8ee06 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] [instance: 178b675e-f4d0-442c-aa69-aece6ea3d636] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:29:00.467265 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-ca7f685c-3ab5-44f8-8e27-a217e2e8ee06 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:29:00.467715 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-ca7f685c-3ab5-44f8-8e27-a217e2e8ee06 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:29:00.468499 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-ca7f685c-3ab5-44f8-8e27-a217e2e8ee06 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:29:00.468938 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-ca7f685c-3ab5-44f8-8e27-a217e2e8ee06 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:29:00.615716 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-ca7f685c-3ab5-44f8-8e27-a217e2e8ee06 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8f887f5689419e9e31a0ba43f76ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62d19c831574f9b99c993b5e41c645d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:29:00.625475 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-ca7f685c-3ab5-44f8-8e27-a217e2e8ee06 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] 10.222.0.46 "GET /compute/v2.1/servers/178b675e-f4d0-442c-aa69-aece6ea3d636" status: 200 len: 1736 microversion: 2.1 time: 0.171053 Aug 04 05:29:00.633852 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 209/421] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:29:00 2022] GET /compute/v2.1/servers/178b675e-f4d0-442c-aa69-aece6ea3d636 => generated 1736 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:29:01.425315 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-88ca6d7a-04e6-4f2c-990f-f294d5eeca7b tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:29:01.425846 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-88ca6d7a-04e6-4f2c-990f-f294d5eeca7b tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] [instance: 384721d7-1467-45cd-af93-eb458115f75e] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:29:01.433197 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-88ca6d7a-04e6-4f2c-990f-f294d5eeca7b tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:29:01.433635 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-88ca6d7a-04e6-4f2c-990f-f294d5eeca7b tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:29:01.434429 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-88ca6d7a-04e6-4f2c-990f-f294d5eeca7b tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:29:01.434860 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-88ca6d7a-04e6-4f2c-990f-f294d5eeca7b tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:29:01.449446 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.wsgi [None req-88ca6d7a-04e6-4f2c-990f-f294d5eeca7b tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] HTTP exception thrown: Instance 384721d7-1467-45cd-af93-eb458115f75e could not be found. Aug 04 05:29:01.451139 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-88ca6d7a-04e6-4f2c-990f-f294d5eeca7b tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Request method failure captured: Aug 04 05:29:01.451139 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: request: GET /compute/v2.1/servers/384721d7-1467-45cd-af93-eb458115f75e HTTP/1.1 Aug 04 05:29:01.451139 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: Accept: application/json Aug 04 05:29:01.451139 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: Accept-Encoding: identity Aug 04 05:29:01.451139 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: Connection: close Aug 04 05:29:01.451139 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: Content-Length: 0 Aug 04 05:29:01.451139 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: Content-Type: application/json Aug 04 05:29:01.451139 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: Host: 10.222.0.46 Aug 04 05:29:01.451139 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: Openstack-System-Scope: None Aug 04 05:29:01.451139 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: User-Agent: python-urllib3/1.26.11 Aug 04 05:29:01.451139 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Auth-Token: gAAAAABi61g0x_8sFigG1jfXTOdqOMY1_3lK7UxaN3VmL5lqQXtIkCz4pWJYdYey2zGuiTigaV5gr0UWhaKZvxst4Kz-KOaAO64aM30ubWqVQfLIrJqf-RP6LF-c0ZabM-LUcJmxEmCuhHsUTEzNbVJn1WT0ja1hpuQC9pVY6l0Uzp1TYNzYyh0 Aug 04 05:29:01.451139 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Domain-Id: None Aug 04 05:29:01.451139 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Domain-Name: None Aug 04 05:29:01.451139 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Identity-Status: Confirmed Aug 04 05:29:01.451139 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Is-Admin-Project: True Aug 04 05:29:01.451139 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Project-Domain-Id: default Aug 04 05:29:01.451139 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Project-Domain-Name: Default Aug 04 05:29:01.451139 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Project-Id: faead990837d43de8ec54bfaf24361de Aug 04 05:29:01.451139 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Project-Name: tempest-AttachVolumeNegativeTest-710656709 Aug 04 05:29:01.451139 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Role: member,reader Aug 04 05:29:01.451139 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Roles: member,reader Aug 04 05:29:01.452689 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/faead990837d43de8ec54bfaf24361de"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/faead990837d43de8ec54bfaf24361de"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_faead990837d43de8ec54bfaf24361de", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/faead990837d43de8ec54bfaf24361de"}]}] Aug 04 05:29:01.452689 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Tenant: tempest-AttachVolumeNegativeTest-710656709 Aug 04 05:29:01.452689 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Tenant-Id: faead990837d43de8ec54bfaf24361de Aug 04 05:29:01.452689 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-710656709 Aug 04 05:29:01.452689 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-User: tempest-AttachVolumeNegativeTest-710656709-project Aug 04 05:29:01.452689 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-User-Domain-Id: default Aug 04 05:29:01.452689 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-User-Domain-Name: Default Aug 04 05:29:01.452689 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-User-Id: 9cb49b631c234f9a9fd47049b9b2e097 Aug 04 05:29:01.452689 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-User-Name: tempest-AttachVolumeNegativeTest-710656709-project Aug 04 05:29:01.452689 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: method: > Aug 04 05:29:01.452689 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: exception: Instance 384721d7-1467-45cd-af93-eb458115f75e could not be found. Aug 04 05:29:01.452689 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: action_args: {'id': '384721d7-1467-45cd-af93-eb458115f75e'} Aug 04 05:29:01.453541 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 05:29:01.453541 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:29:01.453541 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 05:29:01.453541 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 05:29:01.453541 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 05:29:01.453541 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 05:29:01.453541 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 05:29:01.453541 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 05:29:01.453541 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 05:29:01.453541 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 05:29:01.453541 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 384721d7-1467-45cd-af93-eb458115f75e could not be found. Aug 04 05:29:01.453541 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Aug 04 05:29:01.453541 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:29:01.453541 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Aug 04 05:29:01.453541 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:29:01.453541 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:29:01.453541 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:29:01.453541 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 05:29:01.453541 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 05:29:01.453541 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 05:29:01.454927 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 05:29:01.454927 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 05:29:01.454927 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 05:29:01.454927 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 05:29:01.454927 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 05:29:01.454927 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 05:29:01.454927 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 05:29:01.454927 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 384721d7-1467-45cd-af93-eb458115f75e could not be found. Aug 04 05:29:01.454927 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Aug 04 05:29:01.454927 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:29:01.454927 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Aug 04 05:29:01.454927 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:29:01.454927 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:29:01.454927 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:29:01.454927 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 05:29:01.454927 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 05:29:01.454927 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 384721d7-1467-45cd-af93-eb458115f75e could not be found. Aug 04 05:29:01.454927 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Aug 04 05:29:01.455950 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-88ca6d7a-04e6-4f2c-990f-f294d5eeca7b tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Returning 404 to user: Instance 384721d7-1467-45cd-af93-eb458115f75e could not be found. {{(pid=118477) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 05:29:01.455950 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-88ca6d7a-04e6-4f2c-990f-f294d5eeca7b tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] 10.222.0.46 "GET /compute/v2.1/servers/384721d7-1467-45cd-af93-eb458115f75e" status: 404 len: 111 microversion: 2.1 time: 0.031376 Aug 04 05:29:01.455950 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 213/422] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:29:01 2022] GET /compute/v2.1/servers/384721d7-1467-45cd-af93-eb458115f75e => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 05:29:01.461506 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-4d52f870-836d-40b2-9a8c-9aaf91ce501a tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Calling method '.version_select at 0x7f1475507550>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:29:01.540939 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-4d52f870-836d-40b2-9a8c-9aaf91ce501a tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-963919141" status: 202 len: 0 microversion: 2.1 time: 0.083170 Aug 04 05:29:01.542140 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 210/423] 10.222.0.46 () {58 vars in 1218 bytes} [Thu Aug 4 05:29:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-963919141 => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 05:29:01.647929 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-1640257a-61e8-425b-ab53-68f7f1ca31c7 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:29:01.648531 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-1640257a-61e8-425b-ab53-68f7f1ca31c7 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] [instance: 178b675e-f4d0-442c-aa69-aece6ea3d636] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:29:01.655594 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-1640257a-61e8-425b-ab53-68f7f1ca31c7 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:29:01.656057 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-1640257a-61e8-425b-ab53-68f7f1ca31c7 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:29:01.656844 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-1640257a-61e8-425b-ab53-68f7f1ca31c7 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:29:01.657538 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-1640257a-61e8-425b-ab53-68f7f1ca31c7 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:29:01.806826 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-1640257a-61e8-425b-ab53-68f7f1ca31c7 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8f887f5689419e9e31a0ba43f76ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62d19c831574f9b99c993b5e41c645d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:29:01.816141 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-1640257a-61e8-425b-ab53-68f7f1ca31c7 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] 10.222.0.46 "GET /compute/v2.1/servers/178b675e-f4d0-442c-aa69-aece6ea3d636" status: 200 len: 1736 microversion: 2.1 time: 0.172088 Aug 04 05:29:01.816803 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 214/424] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:29:01 2022] GET /compute/v2.1/servers/178b675e-f4d0-442c-aa69-aece6ea3d636 => generated 1736 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:29:02.465162 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-91921b92-2090-4c79-a755-ec371f5aa535 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Action: 'create', calling method: .version_select at 0x7f1475e97c10>, body: {"keypair": {"name": "tempest-keypair-2077896344", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDChU4qGinebSn36t/gEHy5nAFN5uZCZeBdRmXU+lcPnKeiJEjM/MrUWTEYcdGhiLL0UG+m6d/1wRmkuqyEFnFk+BT4ABfac8C+wRrIzDMdrGLr98bNaV5wKyzKkyWmSNg=="}} {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:29:02.482272 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.quota [None req-91921b92-2090-4c79-a755-ec371f5aa535 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Getting quotas for project faead990837d43de8ec54bfaf24361de. Resources: {'key_pairs'} {{(pid=118476) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 05:29:02.487016 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.quota [None req-91921b92-2090-4c79-a755-ec371f5aa535 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Getting quotas for user 9cb49b631c234f9a9fd47049b9b2e097 and project faead990837d43de8ec54bfaf24361de. Resources: {'key_pairs'} {{(pid=118476) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 05:29:02.603502 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-91921b92-2090-4c79-a755-ec371f5aa535 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.143515 Aug 04 05:29:02.604208 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 211/425] 10.222.0.46 () {60 vars in 1159 bytes} [Thu Aug 4 05:29:02 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:29:02.837742 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-c52c087d-3394-49e5-8544-a9f26dd3f569 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:29:02.838419 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-c52c087d-3394-49e5-8544-a9f26dd3f569 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] [instance: 178b675e-f4d0-442c-aa69-aece6ea3d636] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:29:02.845263 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-c52c087d-3394-49e5-8544-a9f26dd3f569 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:29:02.847477 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-c52c087d-3394-49e5-8544-a9f26dd3f569 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:29:02.847477 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-c52c087d-3394-49e5-8544-a9f26dd3f569 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:29:02.847477 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-c52c087d-3394-49e5-8544-a9f26dd3f569 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:29:02.998180 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-c52c087d-3394-49e5-8544-a9f26dd3f569 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8f887f5689419e9e31a0ba43f76ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62d19c831574f9b99c993b5e41c645d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:29:03.006015 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-c52c087d-3394-49e5-8544-a9f26dd3f569 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] 10.222.0.46 "GET /compute/v2.1/servers/178b675e-f4d0-442c-aa69-aece6ea3d636" status: 200 len: 1736 microversion: 2.1 time: 0.172081 Aug 04 05:29:03.006626 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 215/426] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:29:02 2022] GET /compute/v2.1/servers/178b675e-f4d0-442c-aa69-aece6ea3d636 => generated 1736 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:29:04.027952 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-2ef121b6-aef8-4ade-92e4-fa31bb8bb8e6 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:29:04.028691 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-2ef121b6-aef8-4ade-92e4-fa31bb8bb8e6 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] [instance: 178b675e-f4d0-442c-aa69-aece6ea3d636] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:29:04.030919 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG dbcounter [-] [118476] Writing DB stats nova_api:SELECT=79,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=118476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:29:04.036141 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-2ef121b6-aef8-4ade-92e4-fa31bb8bb8e6 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:29:04.036585 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-2ef121b6-aef8-4ade-92e4-fa31bb8bb8e6 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:29:04.037381 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-2ef121b6-aef8-4ade-92e4-fa31bb8bb8e6 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:29:04.037812 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-2ef121b6-aef8-4ade-92e4-fa31bb8bb8e6 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:29:04.181690 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-2ef121b6-aef8-4ade-92e4-fa31bb8bb8e6 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8f887f5689419e9e31a0ba43f76ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62d19c831574f9b99c993b5e41c645d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:29:04.190455 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-2ef121b6-aef8-4ade-92e4-fa31bb8bb8e6 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] 10.222.0.46 "GET /compute/v2.1/servers/178b675e-f4d0-442c-aa69-aece6ea3d636" status: 200 len: 1736 microversion: 2.1 time: 0.167020 Aug 04 05:29:04.191033 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 212/427] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:29:04 2022] GET /compute/v2.1/servers/178b675e-f4d0-442c-aa69-aece6ea3d636 => generated 1736 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 05:29:04.936115 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-5e017e76-7100-4ba8-8eac-72786da1fc5b tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-8732943", "imageRef": "4613f7d0-37ca-46ad-bb26-dc4990dd7d6f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "87f9b625-400f-447c-aea1-da3d6773a311"}], "security_groups": [{"name": "tempest-securitygroup--1328708217"}], "key_name": "tempest-keypair-2077896344", "user_data": "}} {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:29:05.039981 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.network.neutron [None req-5e017e76-7100-4ba8-8eac-72786da1fc5b tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] validate_networks() for [('87f9b625-400f-447c-aea1-da3d6773a311', None, None, None, None, None)] {{(pid=118477) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 05:29:05.217271 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-286ee567-d294-4e01-ad1e-cd25de37e565 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:29:05.218441 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-286ee567-d294-4e01-ad1e-cd25de37e565 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] [instance: 178b675e-f4d0-442c-aa69-aece6ea3d636] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:29:05.228653 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-286ee567-d294-4e01-ad1e-cd25de37e565 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:29:05.229172 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-286ee567-d294-4e01-ad1e-cd25de37e565 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:29:05.234401 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-286ee567-d294-4e01-ad1e-cd25de37e565 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:29:05.234401 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-286ee567-d294-4e01-ad1e-cd25de37e565 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:29:05.461034 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-286ee567-d294-4e01-ad1e-cd25de37e565 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8f887f5689419e9e31a0ba43f76ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62d19c831574f9b99c993b5e41c645d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:29:05.464505 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG dbcounter [-] [118476] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:29:05.471763 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-286ee567-d294-4e01-ad1e-cd25de37e565 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] 10.222.0.46 "GET /compute/v2.1/servers/178b675e-f4d0-442c-aa69-aece6ea3d636" status: 200 len: 1736 microversion: 2.1 time: 0.262097 Aug 04 05:29:05.471763 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 213/428] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:29:05 2022] GET /compute/v2.1/servers/178b675e-f4d0-442c-aa69-aece6ea3d636 => generated 1736 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:29:05.516605 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.virt.hardware [None req-5e017e76-7100-4ba8-8eac-72786da1fc5b tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Flavor limits 0:0:0 {{(pid=118477) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 05:29:05.517032 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.virt.hardware [None req-5e017e76-7100-4ba8-8eac-72786da1fc5b tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Image limits 0:0:0 {{(pid=118477) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 05:29:05.517506 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.virt.hardware [None req-5e017e76-7100-4ba8-8eac-72786da1fc5b tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Flavor pref 0:0:0 {{(pid=118477) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 05:29:05.517919 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.virt.hardware [None req-5e017e76-7100-4ba8-8eac-72786da1fc5b tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Image pref 0:0:0 {{(pid=118477) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 05:29:05.518358 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.virt.hardware [None req-5e017e76-7100-4ba8-8eac-72786da1fc5b tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118477) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 05:29:05.528780 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-5e017e76-7100-4ba8-8eac-72786da1fc5b tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:29:05.529228 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-5e017e76-7100-4ba8-8eac-72786da1fc5b tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:29:05.530400 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-5e017e76-7100-4ba8-8eac-72786da1fc5b tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:29:05.531002 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-5e017e76-7100-4ba8-8eac-72786da1fc5b tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:29:05.549055 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.quota [None req-5e017e76-7100-4ba8-8eac-72786da1fc5b tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Getting quotas for project faead990837d43de8ec54bfaf24361de. Resources: {'instances', 'cores', 'ram'} {{(pid=118477) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 05:29:05.553062 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.quota [None req-5e017e76-7100-4ba8-8eac-72786da1fc5b tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Getting quotas for user 9cb49b631c234f9a9fd47049b9b2e097 and project faead990837d43de8ec54bfaf24361de. Resources: {'instances', 'cores', 'ram'} {{(pid=118477) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 05:29:05.564982 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-5e017e76-7100-4ba8-8eac-72786da1fc5b tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Going to run 1 instances... {{(pid=118477) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 05:29:05.567278 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-5e017e76-7100-4ba8-8eac-72786da1fc5b tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] [instance: b45583dc-f18b-4b4a-98e3-ef1bdcf41f80] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4613f7d0-37ca-46ad-bb26-dc4990dd7d6f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118477) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 05:29:05.689977 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-5e017e76-7100-4ba8-8eac-72786da1fc5b tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.758576 Aug 04 05:29:05.690657 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 216/429] 10.222.0.46 () {60 vars in 1147 bytes} [Thu Aug 4 05:29:04 2022] POST /compute/v2.1/servers => generated 402 bytes in 760 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 05:29:05.707533 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-582f414a-f123-4eac-9659-5b28865a56f5 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:29:05.708614 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-582f414a-f123-4eac-9659-5b28865a56f5 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] [instance: b45583dc-f18b-4b4a-98e3-ef1bdcf41f80] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:29:05.772968 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-582f414a-f123-4eac-9659-5b28865a56f5 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb49b631c234f9a9fd47049b9b2e097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faead990837d43de8ec54bfaf24361de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:29:05.780782 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-582f414a-f123-4eac-9659-5b28865a56f5 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] 10.222.0.46 "GET /compute/v2.1/servers/b45583dc-f18b-4b4a-98e3-ef1bdcf41f80" status: 200 len: 1239 microversion: 2.1 time: 0.082497 Aug 04 05:29:05.781356 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 214/430] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:29:05 2022] GET /compute/v2.1/servers/b45583dc-f18b-4b4a-98e3-ef1bdcf41f80 => generated 1239 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:29:06.493862 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-121bfcb0-20b8-4968-b5a8-8d0159989ade tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:29:06.494508 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-121bfcb0-20b8-4968-b5a8-8d0159989ade tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] [instance: 178b675e-f4d0-442c-aa69-aece6ea3d636] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:29:06.502121 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-121bfcb0-20b8-4968-b5a8-8d0159989ade tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:29:06.502732 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-121bfcb0-20b8-4968-b5a8-8d0159989ade tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:29:06.503719 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-121bfcb0-20b8-4968-b5a8-8d0159989ade tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:29:06.504152 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-121bfcb0-20b8-4968-b5a8-8d0159989ade tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:29:06.649121 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-121bfcb0-20b8-4968-b5a8-8d0159989ade tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8f887f5689419e9e31a0ba43f76ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62d19c831574f9b99c993b5e41c645d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:29:06.657925 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-121bfcb0-20b8-4968-b5a8-8d0159989ade tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] 10.222.0.46 "GET /compute/v2.1/servers/178b675e-f4d0-442c-aa69-aece6ea3d636" status: 200 len: 1736 microversion: 2.1 time: 0.169060 Aug 04 05:29:06.658512 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 217/431] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:29:06 2022] GET /compute/v2.1/servers/178b675e-f4d0-442c-aa69-aece6ea3d636 => generated 1736 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:29:06.802699 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-2670bba5-a0c6-4749-a27b-c3ec0a791065 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:29:06.803305 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-2670bba5-a0c6-4749-a27b-c3ec0a791065 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] [instance: b45583dc-f18b-4b4a-98e3-ef1bdcf41f80] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:29:06.811070 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-2670bba5-a0c6-4749-a27b-c3ec0a791065 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:29:06.811508 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-2670bba5-a0c6-4749-a27b-c3ec0a791065 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:29:06.812265 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-2670bba5-a0c6-4749-a27b-c3ec0a791065 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:29:06.812694 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-2670bba5-a0c6-4749-a27b-c3ec0a791065 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:29:06.875333 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-2670bba5-a0c6-4749-a27b-c3ec0a791065 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb49b631c234f9a9fd47049b9b2e097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faead990837d43de8ec54bfaf24361de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:29:06.882929 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-2670bba5-a0c6-4749-a27b-c3ec0a791065 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] 10.222.0.46 "GET /compute/v2.1/servers/b45583dc-f18b-4b4a-98e3-ef1bdcf41f80" status: 200 len: 1243 microversion: 2.1 time: 0.084251 Aug 04 05:29:06.883497 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 215/432] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:29:06 2022] GET /compute/v2.1/servers/b45583dc-f18b-4b4a-98e3-ef1bdcf41f80 => generated 1243 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:29:07.680070 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-eedd607f-e9fd-4d9d-95d6-212366aeea08 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:29:07.680669 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-eedd607f-e9fd-4d9d-95d6-212366aeea08 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] [instance: 178b675e-f4d0-442c-aa69-aece6ea3d636] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:29:07.683124 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG dbcounter [-] [118477] Writing DB stats nova_api:SELECT=81,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=118477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:29:07.689253 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-eedd607f-e9fd-4d9d-95d6-212366aeea08 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:29:07.689695 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-eedd607f-e9fd-4d9d-95d6-212366aeea08 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:29:07.690483 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-eedd607f-e9fd-4d9d-95d6-212366aeea08 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:29:07.690917 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-eedd607f-e9fd-4d9d-95d6-212366aeea08 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:29:07.833221 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-eedd607f-e9fd-4d9d-95d6-212366aeea08 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8f887f5689419e9e31a0ba43f76ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62d19c831574f9b99c993b5e41c645d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:29:07.842206 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-eedd607f-e9fd-4d9d-95d6-212366aeea08 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] 10.222.0.46 "GET /compute/v2.1/servers/178b675e-f4d0-442c-aa69-aece6ea3d636" status: 200 len: 1736 microversion: 2.1 time: 0.166226 Aug 04 05:29:07.842804 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 218/433] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:29:07 2022] GET /compute/v2.1/servers/178b675e-f4d0-442c-aa69-aece6ea3d636 => generated 1736 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:29:07.905231 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-9e6f3461-0e7a-4a72-aaf1-69e20c846a6c tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:29:07.905845 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-9e6f3461-0e7a-4a72-aaf1-69e20c846a6c tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] [instance: b45583dc-f18b-4b4a-98e3-ef1bdcf41f80] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:29:07.914119 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-9e6f3461-0e7a-4a72-aaf1-69e20c846a6c tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:29:07.914596 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-9e6f3461-0e7a-4a72-aaf1-69e20c846a6c tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:29:07.915406 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-9e6f3461-0e7a-4a72-aaf1-69e20c846a6c tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:29:07.915842 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-9e6f3461-0e7a-4a72-aaf1-69e20c846a6c tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:29:07.997943 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-9e6f3461-0e7a-4a72-aaf1-69e20c846a6c tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb49b631c234f9a9fd47049b9b2e097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faead990837d43de8ec54bfaf24361de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:29:08.005630 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-9e6f3461-0e7a-4a72-aaf1-69e20c846a6c tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] 10.222.0.46 "GET /compute/v2.1/servers/b45583dc-f18b-4b4a-98e3-ef1bdcf41f80" status: 200 len: 1299 microversion: 2.1 time: 0.104576 Aug 04 05:29:08.006375 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 216/434] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:29:07 2022] GET /compute/v2.1/servers/b45583dc-f18b-4b4a-98e3-ef1bdcf41f80 => generated 1299 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:29:08.865679 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-fdad592d-c66a-43f7-ab38-ec7961431d02 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:29:08.866397 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-fdad592d-c66a-43f7-ab38-ec7961431d02 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] [instance: 178b675e-f4d0-442c-aa69-aece6ea3d636] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:29:08.873790 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-fdad592d-c66a-43f7-ab38-ec7961431d02 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:29:08.874237 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-fdad592d-c66a-43f7-ab38-ec7961431d02 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:29:08.875050 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-fdad592d-c66a-43f7-ab38-ec7961431d02 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:29:08.875516 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-fdad592d-c66a-43f7-ab38-ec7961431d02 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:29:08.879709 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG dbcounter [-] [118477] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:29:09.006900 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-fdad592d-c66a-43f7-ab38-ec7961431d02 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8f887f5689419e9e31a0ba43f76ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62d19c831574f9b99c993b5e41c645d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:29:09.015171 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-fdad592d-c66a-43f7-ab38-ec7961431d02 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] 10.222.0.46 "GET /compute/v2.1/servers/178b675e-f4d0-442c-aa69-aece6ea3d636" status: 200 len: 1736 microversion: 2.1 time: 0.153482 Aug 04 05:29:09.015743 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 219/435] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:29:08 2022] GET /compute/v2.1/servers/178b675e-f4d0-442c-aa69-aece6ea3d636 => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:29:09.026857 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-4e9e61c4-68bb-45e1-b9bb-9b8300e74b81 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:29:09.027582 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-4e9e61c4-68bb-45e1-b9bb-9b8300e74b81 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] [instance: b45583dc-f18b-4b4a-98e3-ef1bdcf41f80] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:29:09.034590 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-4e9e61c4-68bb-45e1-b9bb-9b8300e74b81 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:29:09.035036 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-4e9e61c4-68bb-45e1-b9bb-9b8300e74b81 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:29:09.035795 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-4e9e61c4-68bb-45e1-b9bb-9b8300e74b81 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:29:09.036231 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-4e9e61c4-68bb-45e1-b9bb-9b8300e74b81 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:29:09.103721 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-4e9e61c4-68bb-45e1-b9bb-9b8300e74b81 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb49b631c234f9a9fd47049b9b2e097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faead990837d43de8ec54bfaf24361de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:29:09.113915 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-4e9e61c4-68bb-45e1-b9bb-9b8300e74b81 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] 10.222.0.46 "GET /compute/v2.1/servers/b45583dc-f18b-4b4a-98e3-ef1bdcf41f80" status: 200 len: 1299 microversion: 2.1 time: 0.090773 Aug 04 05:29:09.114616 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 217/436] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:29:09 2022] GET /compute/v2.1/servers/b45583dc-f18b-4b4a-98e3-ef1bdcf41f80 => generated 1299 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:29:10.037233 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-b36ef889-75d1-4de7-b4a7-1e2f2b878cb4 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:29:10.037831 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-b36ef889-75d1-4de7-b4a7-1e2f2b878cb4 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] [instance: 178b675e-f4d0-442c-aa69-aece6ea3d636] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:29:10.045364 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-b36ef889-75d1-4de7-b4a7-1e2f2b878cb4 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:29:10.045809 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-b36ef889-75d1-4de7-b4a7-1e2f2b878cb4 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:29:10.046598 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-b36ef889-75d1-4de7-b4a7-1e2f2b878cb4 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:29:10.047019 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-b36ef889-75d1-4de7-b4a7-1e2f2b878cb4 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:29:10.136437 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-fadcf5ea-8ac5-40d9-8b15-37f77a838d53 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:29:10.137275 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-fadcf5ea-8ac5-40d9-8b15-37f77a838d53 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] [instance: b45583dc-f18b-4b4a-98e3-ef1bdcf41f80] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:29:10.145746 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-fadcf5ea-8ac5-40d9-8b15-37f77a838d53 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:29:10.146194 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-fadcf5ea-8ac5-40d9-8b15-37f77a838d53 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:29:10.147050 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-fadcf5ea-8ac5-40d9-8b15-37f77a838d53 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:29:10.147504 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-fadcf5ea-8ac5-40d9-8b15-37f77a838d53 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:29:10.181869 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-b36ef889-75d1-4de7-b4a7-1e2f2b878cb4 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8f887f5689419e9e31a0ba43f76ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62d19c831574f9b99c993b5e41c645d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:29:10.191221 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-b36ef889-75d1-4de7-b4a7-1e2f2b878cb4 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] 10.222.0.46 "GET /compute/v2.1/servers/178b675e-f4d0-442c-aa69-aece6ea3d636" status: 200 len: 1736 microversion: 2.1 time: 0.157755 Aug 04 05:29:10.191891 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 220/437] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:29:10 2022] GET /compute/v2.1/servers/178b675e-f4d0-442c-aa69-aece6ea3d636 => generated 1736 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:29:10.213486 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-fadcf5ea-8ac5-40d9-8b15-37f77a838d53 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb49b631c234f9a9fd47049b9b2e097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faead990837d43de8ec54bfaf24361de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:29:10.221990 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-fadcf5ea-8ac5-40d9-8b15-37f77a838d53 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] 10.222.0.46 "GET /compute/v2.1/servers/b45583dc-f18b-4b4a-98e3-ef1bdcf41f80" status: 200 len: 1309 microversion: 2.1 time: 0.089367 Aug 04 05:29:10.222612 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 218/438] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:29:10 2022] GET /compute/v2.1/servers/b45583dc-f18b-4b4a-98e3-ef1bdcf41f80 => generated 1309 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 05:29:11.216434 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-4333d3c3-854c-45e3-b9d1-30a06a5a1a54 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:29:11.217761 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-4333d3c3-854c-45e3-b9d1-30a06a5a1a54 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] [instance: 178b675e-f4d0-442c-aa69-aece6ea3d636] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:29:11.226347 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-4333d3c3-854c-45e3-b9d1-30a06a5a1a54 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:29:11.227097 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-4333d3c3-854c-45e3-b9d1-30a06a5a1a54 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:29:11.228072 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-4333d3c3-854c-45e3-b9d1-30a06a5a1a54 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:29:11.228723 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-4333d3c3-854c-45e3-b9d1-30a06a5a1a54 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:29:11.244230 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-61c4b8a8-562b-47c6-96db-853edbe6acd2 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:29:11.249434 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-61c4b8a8-562b-47c6-96db-853edbe6acd2 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] [instance: b45583dc-f18b-4b4a-98e3-ef1bdcf41f80] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:29:11.266279 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-61c4b8a8-562b-47c6-96db-853edbe6acd2 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:29:11.267202 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-61c4b8a8-562b-47c6-96db-853edbe6acd2 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:29:11.268185 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-61c4b8a8-562b-47c6-96db-853edbe6acd2 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:29:11.268788 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-61c4b8a8-562b-47c6-96db-853edbe6acd2 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:29:11.507764 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-4333d3c3-854c-45e3-b9d1-30a06a5a1a54 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8f887f5689419e9e31a0ba43f76ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62d19c831574f9b99c993b5e41c645d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:29:11.517138 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-4333d3c3-854c-45e3-b9d1-30a06a5a1a54 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] 10.222.0.46 "GET /compute/v2.1/servers/178b675e-f4d0-442c-aa69-aece6ea3d636" status: 200 len: 1736 microversion: 2.1 time: 0.308391 Aug 04 05:29:11.517927 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 221/439] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:29:11 2022] GET /compute/v2.1/servers/178b675e-f4d0-442c-aa69-aece6ea3d636 => generated 1736 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:29:11.519077 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-61c4b8a8-562b-47c6-96db-853edbe6acd2 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb49b631c234f9a9fd47049b9b2e097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faead990837d43de8ec54bfaf24361de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:29:11.526628 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-61c4b8a8-562b-47c6-96db-853edbe6acd2 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] 10.222.0.46 "GET /compute/v2.1/servers/b45583dc-f18b-4b4a-98e3-ef1bdcf41f80" status: 200 len: 1365 microversion: 2.1 time: 0.286664 Aug 04 05:29:11.527204 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 219/440] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:29:11 2022] GET /compute/v2.1/servers/b45583dc-f18b-4b4a-98e3-ef1bdcf41f80 => generated 1365 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 05:29:12.539211 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-f32ed646-c545-49d5-b8e8-70c529611d81 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:29:12.539801 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-f32ed646-c545-49d5-b8e8-70c529611d81 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] [instance: 178b675e-f4d0-442c-aa69-aece6ea3d636] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:29:12.546759 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-f32ed646-c545-49d5-b8e8-70c529611d81 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:29:12.547851 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-f32ed646-c545-49d5-b8e8-70c529611d81 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:29:12.548642 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-f32ed646-c545-49d5-b8e8-70c529611d81 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:29:12.549114 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-f32ed646-c545-49d5-b8e8-70c529611d81 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:29:12.549791 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-941c2bc1-45e4-4f15-8838-8ad332ec272a tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:29:12.550667 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-941c2bc1-45e4-4f15-8838-8ad332ec272a tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] [instance: b45583dc-f18b-4b4a-98e3-ef1bdcf41f80] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:29:12.559046 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-941c2bc1-45e4-4f15-8838-8ad332ec272a tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:29:12.560242 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-941c2bc1-45e4-4f15-8838-8ad332ec272a tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:29:12.561279 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-941c2bc1-45e4-4f15-8838-8ad332ec272a tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:29:12.561893 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-941c2bc1-45e4-4f15-8838-8ad332ec272a tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:29:12.850122 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-f32ed646-c545-49d5-b8e8-70c529611d81 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8f887f5689419e9e31a0ba43f76ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62d19c831574f9b99c993b5e41c645d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:29:12.860422 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-f32ed646-c545-49d5-b8e8-70c529611d81 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] 10.222.0.46 "GET /compute/v2.1/servers/178b675e-f4d0-442c-aa69-aece6ea3d636" status: 200 len: 1736 microversion: 2.1 time: 0.324787 Aug 04 05:29:12.861363 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-941c2bc1-45e4-4f15-8838-8ad332ec272a tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb49b631c234f9a9fd47049b9b2e097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faead990837d43de8ec54bfaf24361de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:29:12.875282 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 222/441] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:29:12 2022] GET /compute/v2.1/servers/178b675e-f4d0-442c-aa69-aece6ea3d636 => generated 1736 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:29:12.881168 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-941c2bc1-45e4-4f15-8838-8ad332ec272a tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] 10.222.0.46 "GET /compute/v2.1/servers/b45583dc-f18b-4b4a-98e3-ef1bdcf41f80" status: 200 len: 1365 microversion: 2.1 time: 0.335589 Aug 04 05:29:12.881752 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 220/442] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:29:12 2022] GET /compute/v2.1/servers/b45583dc-f18b-4b4a-98e3-ef1bdcf41f80 => generated 1365 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 05:29:13.247749 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [req-aca15332-5c7d-464a-9def-32f55f43bfe4 req-9c2ca547-3200-44b6-a2d3-3f70db594871 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b45583dc-f18b-4b4a-98e3-ef1bdcf41f80", "tag": "a18f6abd-9021-4bcf-bf94-d461caa21de9"}]} {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:29:13.257496 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [req-aca15332-5c7d-464a-9def-32f55f43bfe4 req-9c2ca547-3200-44b6-a2d3-3f70db594871 service nova] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:29:13.258023 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [req-aca15332-5c7d-464a-9def-32f55f43bfe4 req-9c2ca547-3200-44b6-a2d3-3f70db594871 service nova] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:29:13.271171 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.compute.server_external_events [req-aca15332-5c7d-464a-9def-32f55f43bfe4 req-9c2ca547-3200-44b6-a2d3-3f70db594871 service nova] Creating event network-changed:a18f6abd-9021-4bcf-bf94-d461caa21de9 for instance b45583dc-f18b-4b4a-98e3-ef1bdcf41f80 on hv-cinder-85207 Aug 04 05:29:13.276793 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [req-aca15332-5c7d-464a-9def-32f55f43bfe4 req-9c2ca547-3200-44b6-a2d3-3f70db594871 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032852 Aug 04 05:29:13.277607 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 223/443] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Aug 4 05:29:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:29:13.882710 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-2e05ca50-2d76-4a70-9069-a8446e0b627a tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:29:13.883315 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-2e05ca50-2d76-4a70-9069-a8446e0b627a tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] [instance: 178b675e-f4d0-442c-aa69-aece6ea3d636] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:29:13.890367 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-2e05ca50-2d76-4a70-9069-a8446e0b627a tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:29:13.890820 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-2e05ca50-2d76-4a70-9069-a8446e0b627a tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:29:13.891628 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-2e05ca50-2d76-4a70-9069-a8446e0b627a tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:29:13.892061 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-2e05ca50-2d76-4a70-9069-a8446e0b627a tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:29:13.904064 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-be1b2240-fd65-4df3-9480-486c95ced647 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:29:13.905395 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-be1b2240-fd65-4df3-9480-486c95ced647 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] [instance: b45583dc-f18b-4b4a-98e3-ef1bdcf41f80] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:29:13.913217 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-be1b2240-fd65-4df3-9480-486c95ced647 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:29:13.913802 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-be1b2240-fd65-4df3-9480-486c95ced647 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:29:13.914726 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-be1b2240-fd65-4df3-9480-486c95ced647 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:29:13.915427 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-be1b2240-fd65-4df3-9480-486c95ced647 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:29:14.140242 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-2e05ca50-2d76-4a70-9069-a8446e0b627a tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8f887f5689419e9e31a0ba43f76ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62d19c831574f9b99c993b5e41c645d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:29:14.143864 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-be1b2240-fd65-4df3-9480-486c95ced647 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb49b631c234f9a9fd47049b9b2e097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faead990837d43de8ec54bfaf24361de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:29:14.148240 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-2e05ca50-2d76-4a70-9069-a8446e0b627a tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] 10.222.0.46 "GET /compute/v2.1/servers/178b675e-f4d0-442c-aa69-aece6ea3d636" status: 200 len: 1736 microversion: 2.1 time: 0.269487 Aug 04 05:29:14.148824 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 221/444] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:29:13 2022] GET /compute/v2.1/servers/178b675e-f4d0-442c-aa69-aece6ea3d636 => generated 1736 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:29:14.151618 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-be1b2240-fd65-4df3-9480-486c95ced647 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] 10.222.0.46 "GET /compute/v2.1/servers/b45583dc-f18b-4b4a-98e3-ef1bdcf41f80" status: 200 len: 1365 microversion: 2.1 time: 0.252267 Aug 04 05:29:14.152365 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 224/445] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:29:13 2022] GET /compute/v2.1/servers/b45583dc-f18b-4b4a-98e3-ef1bdcf41f80 => generated 1365 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 05:29:15.174156 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-686a75ba-570f-4c5e-b203-ca0a11e6fa87 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:29:15.174965 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-686a75ba-570f-4c5e-b203-ca0a11e6fa87 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] [instance: 178b675e-f4d0-442c-aa69-aece6ea3d636] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:29:15.176711 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-d045ba26-fe7c-4f03-a3c7-c0683289dc30 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:29:15.178095 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-d045ba26-fe7c-4f03-a3c7-c0683289dc30 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] [instance: b45583dc-f18b-4b4a-98e3-ef1bdcf41f80] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:29:15.181688 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-686a75ba-570f-4c5e-b203-ca0a11e6fa87 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:29:15.182275 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-686a75ba-570f-4c5e-b203-ca0a11e6fa87 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:29:15.183389 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-686a75ba-570f-4c5e-b203-ca0a11e6fa87 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:29:15.183894 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-686a75ba-570f-4c5e-b203-ca0a11e6fa87 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:29:15.185697 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-d045ba26-fe7c-4f03-a3c7-c0683289dc30 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:29:15.186884 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-d045ba26-fe7c-4f03-a3c7-c0683289dc30 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:29:15.187696 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-d045ba26-fe7c-4f03-a3c7-c0683289dc30 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:29:15.188122 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-d045ba26-fe7c-4f03-a3c7-c0683289dc30 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:29:15.395690 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-d045ba26-fe7c-4f03-a3c7-c0683289dc30 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb49b631c234f9a9fd47049b9b2e097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faead990837d43de8ec54bfaf24361de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:29:15.398954 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-686a75ba-570f-4c5e-b203-ca0a11e6fa87 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8f887f5689419e9e31a0ba43f76ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62d19c831574f9b99c993b5e41c645d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:29:15.403526 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-d045ba26-fe7c-4f03-a3c7-c0683289dc30 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] 10.222.0.46 "GET /compute/v2.1/servers/b45583dc-f18b-4b4a-98e3-ef1bdcf41f80" status: 200 len: 1365 microversion: 2.1 time: 0.231516 Aug 04 05:29:15.407851 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 225/446] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:29:15 2022] GET /compute/v2.1/servers/b45583dc-f18b-4b4a-98e3-ef1bdcf41f80 => generated 1365 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:29:15.408796 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-686a75ba-570f-4c5e-b203-ca0a11e6fa87 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] 10.222.0.46 "GET /compute/v2.1/servers/178b675e-f4d0-442c-aa69-aece6ea3d636" status: 200 len: 1716 microversion: 2.1 time: 0.240898 Aug 04 05:29:15.409577 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 222/447] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:29:15 2022] GET /compute/v2.1/servers/178b675e-f4d0-442c-aa69-aece6ea3d636 => generated 1716 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:29:15.533241 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-595a25c4-d55e-4e29-aebe-6e59bfea1ceb tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:29:15.533740 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-595a25c4-d55e-4e29-aebe-6e59bfea1ceb tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] [instance: 178b675e-f4d0-442c-aa69-aece6ea3d636] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:29:15.538862 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG dbcounter [-] [118477] Writing DB stats nova_cell0:SELECT=2 {{(pid=118477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:29:15.540831 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-595a25c4-d55e-4e29-aebe-6e59bfea1ceb tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:29:15.541282 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-595a25c4-d55e-4e29-aebe-6e59bfea1ceb tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:29:15.542038 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-595a25c4-d55e-4e29-aebe-6e59bfea1ceb tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:29:15.542517 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-595a25c4-d55e-4e29-aebe-6e59bfea1ceb tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:29:15.571721 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG dbcounter [-] [118477] Writing DB stats nova_cell0:SELECT=6 {{(pid=118477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:29:15.672208 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.wsgi [None req-595a25c4-d55e-4e29-aebe-6e59bfea1ceb tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] HTTP exception thrown: Cannot 'detach_volume' instance 178b675e-f4d0-442c-aa69-aece6ea3d636 while it is in vm_state rescued Aug 04 05:29:15.674019 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-595a25c4-d55e-4e29-aebe-6e59bfea1ceb tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Request method failure captured: Aug 04 05:29:15.674019 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: request: DELETE /compute/v2.1/servers/178b675e-f4d0-442c-aa69-aece6ea3d636/os-volume_attachments/76829b8a-2bf6-4ac0-9484-92fae22049e3 HTTP/1.1 Aug 04 05:29:15.674019 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: Accept: application/json Aug 04 05:29:15.674019 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: Accept-Encoding: identity Aug 04 05:29:15.674019 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: Connection: close Aug 04 05:29:15.674019 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: Content-Length: 0 Aug 04 05:29:15.674019 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: Content-Type: application/json Aug 04 05:29:15.674019 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: Host: 10.222.0.46 Aug 04 05:29:15.674019 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: Openstack-System-Scope: None Aug 04 05:29:15.674019 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: User-Agent: python-urllib3/1.26.11 Aug 04 05:29:15.674019 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Auth-Token: gAAAAABi61g53OabLgO4gW69xhev3-hVAHcOcUE9Y2w5YBGtgFfk0SOjtoLwecmlrXgTD_O28rN04Wx-xl4rDlr6cEau3Mp5S6ihh8QrLzUUzoS_WNUMRZYqOqiUmHYH7qSat4VCjMgYwUWTzg9zUzn68Xb9K2m9ofVkhx1oUsZEWZ2JuoREn50 Aug 04 05:29:15.674019 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Domain-Id: None Aug 04 05:29:15.674019 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Domain-Name: None Aug 04 05:29:15.674019 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Identity-Status: Confirmed Aug 04 05:29:15.674019 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Is-Admin-Project: True Aug 04 05:29:15.674019 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Project-Domain-Id: default Aug 04 05:29:15.674019 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Project-Domain-Name: Default Aug 04 05:29:15.674019 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Project-Id: b62d19c831574f9b99c993b5e41c645d Aug 04 05:29:15.674019 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1543928594 Aug 04 05:29:15.674019 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Role: member,reader Aug 04 05:29:15.674019 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Roles: member,reader Aug 04 05:29:15.675639 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/b62d19c831574f9b99c993b5e41c645d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/b62d19c831574f9b99c993b5e41c645d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_b62d19c831574f9b99c993b5e41c645d", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/b62d19c831574f9b99c993b5e41c645d"}]}] Aug 04 05:29:15.675639 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1543928594 Aug 04 05:29:15.675639 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Tenant-Id: b62d19c831574f9b99c993b5e41c645d Aug 04 05:29:15.675639 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1543928594 Aug 04 05:29:15.675639 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-User: tempest-ServerRescueNegativeTestJSON-1543928594-project Aug 04 05:29:15.675639 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-User-Domain-Id: default Aug 04 05:29:15.675639 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-User-Domain-Name: Default Aug 04 05:29:15.675639 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-User-Id: ab8f887f5689419e9e31a0ba43f76ada Aug 04 05:29:15.675639 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1543928594-project Aug 04 05:29:15.675639 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: method: > Aug 04 05:29:15.675639 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: exception: Cannot 'detach_volume' instance 178b675e-f4d0-442c-aa69-aece6ea3d636 while it is in vm_state rescued Aug 04 05:29:15.676407 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: action_args: {'server_id': '178b675e-f4d0-442c-aa69-aece6ea3d636', 'id': '76829b8a-2bf6-4ac0-9484-92fae22049e3'} Aug 04 05:29:15.676407 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 05:29:15.676407 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:29:15.676407 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 04 05:29:15.676407 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 04 05:29:15.676407 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 04 05:29:15.676407 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 04 05:29:15.676407 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 04 05:29:15.676407 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 04 05:29:15.676407 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 178b675e-f4d0-442c-aa69-aece6ea3d636 in vm_state rescued. Cannot detach_volume while the instance is in this state. Aug 04 05:29:15.676407 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Aug 04 05:29:15.676407 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:29:15.676407 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Aug 04 05:29:15.676407 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:29:15.676407 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:29:15.676407 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:29:15.676407 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 05:29:15.676407 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 05:29:15.676407 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 05:29:15.676407 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 05:29:15.677661 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Aug 04 05:29:15.677661 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 04 05:29:15.677661 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 04 05:29:15.677661 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 04 05:29:15.677661 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 178b675e-f4d0-442c-aa69-aece6ea3d636 while it is in vm_state rescued Aug 04 05:29:15.677661 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Aug 04 05:29:15.677661 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:29:15.677661 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Aug 04 05:29:15.677661 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:29:15.677661 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:29:15.677661 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:29:15.677661 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 05:29:15.677661 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 05:29:15.677661 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 178b675e-f4d0-442c-aa69-aece6ea3d636 while it is in vm_state rescued Aug 04 05:29:15.677661 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Aug 04 05:29:15.677661 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-595a25c4-d55e-4e29-aebe-6e59bfea1ceb tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Returning 409 to user: Cannot 'detach_volume' instance 178b675e-f4d0-442c-aa69-aece6ea3d636 while it is in vm_state rescued {{(pid=118477) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 05:29:15.678660 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-595a25c4-d55e-4e29-aebe-6e59bfea1ceb tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] 10.222.0.46 "DELETE /compute/v2.1/servers/178b675e-f4d0-442c-aa69-aece6ea3d636/os-volume_attachments/76829b8a-2bf6-4ac0-9484-92fae22049e3" status: 409 len: 152 microversion: 2.1 time: 0.147121 Aug 04 05:29:15.678660 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 226/448] 10.222.0.46 () {58 vars in 1416 bytes} [Thu Aug 4 05:29:15 2022] DELETE /compute/v2.1/servers/178b675e-f4d0-442c-aa69-aece6ea3d636/os-volume_attachments/76829b8a-2bf6-4ac0-9484-92fae22049e3 => generated 152 bytes in 148 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 04 05:29:15.684519 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-445d9744-593a-4dd5-877d-109f08ac58d6 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:29:15.685060 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-445d9744-593a-4dd5-877d-109f08ac58d6 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] [instance: 178b675e-f4d0-442c-aa69-aece6ea3d636] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:29:15.693148 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-445d9744-593a-4dd5-877d-109f08ac58d6 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:29:15.693530 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-445d9744-593a-4dd5-877d-109f08ac58d6 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:29:15.694365 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-445d9744-593a-4dd5-877d-109f08ac58d6 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:29:15.694769 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-445d9744-593a-4dd5-877d-109f08ac58d6 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:29:15.777993 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG dbcounter [-] [118476] Writing DB stats nova_cell0:SELECT=6 {{(pid=118476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:29:15.955006 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-445d9744-593a-4dd5-877d-109f08ac58d6 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] 10.222.0.46 "POST /compute/v2.1/servers/178b675e-f4d0-442c-aa69-aece6ea3d636/action" status: 202 len: 0 microversion: 2.1 time: 0.274005 Aug 04 05:29:15.955578 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 223/449] 10.222.0.46 () {60 vars in 1278 bytes} [Thu Aug 4 05:29:15 2022] POST /compute/v2.1/servers/178b675e-f4d0-442c-aa69-aece6ea3d636/action => generated 0 bytes in 276 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 05:29:15.963613 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-dd2fb628-8e45-41cd-9f20-6a6eed724d44 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:29:15.964222 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-dd2fb628-8e45-41cd-9f20-6a6eed724d44 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] [instance: 178b675e-f4d0-442c-aa69-aece6ea3d636] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:29:15.974381 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-dd2fb628-8e45-41cd-9f20-6a6eed724d44 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:29:15.974829 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-dd2fb628-8e45-41cd-9f20-6a6eed724d44 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:29:15.975590 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-dd2fb628-8e45-41cd-9f20-6a6eed724d44 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:29:15.976019 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-dd2fb628-8e45-41cd-9f20-6a6eed724d44 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:29:16.426996 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-a3639c95-9770-488b-b30f-952f501bc8e2 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:29:16.427697 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-a3639c95-9770-488b-b30f-952f501bc8e2 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] [instance: b45583dc-f18b-4b4a-98e3-ef1bdcf41f80] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:29:16.434116 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-a3639c95-9770-488b-b30f-952f501bc8e2 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:29:16.434646 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-a3639c95-9770-488b-b30f-952f501bc8e2 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:29:16.436161 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-a3639c95-9770-488b-b30f-952f501bc8e2 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:29:16.436873 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-a3639c95-9770-488b-b30f-952f501bc8e2 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:29:16.441189 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-dd2fb628-8e45-41cd-9f20-6a6eed724d44 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8f887f5689419e9e31a0ba43f76ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62d19c831574f9b99c993b5e41c645d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:29:16.456924 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-dd2fb628-8e45-41cd-9f20-6a6eed724d44 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] 10.222.0.46 "GET /compute/v2.1/servers/178b675e-f4d0-442c-aa69-aece6ea3d636" status: 200 len: 1724 microversion: 2.1 time: 0.497075 Aug 04 05:29:16.458013 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 227/450] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:29:15 2022] GET /compute/v2.1/servers/178b675e-f4d0-442c-aa69-aece6ea3d636 => generated 1724 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:29:16.696838 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-a3639c95-9770-488b-b30f-952f501bc8e2 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb49b631c234f9a9fd47049b9b2e097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faead990837d43de8ec54bfaf24361de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:29:16.705006 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-a3639c95-9770-488b-b30f-952f501bc8e2 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] 10.222.0.46 "GET /compute/v2.1/servers/b45583dc-f18b-4b4a-98e3-ef1bdcf41f80" status: 200 len: 1365 microversion: 2.1 time: 0.282824 Aug 04 05:29:16.705606 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 224/451] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:29:16 2022] GET /compute/v2.1/servers/b45583dc-f18b-4b4a-98e3-ef1bdcf41f80 => generated 1365 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 05:29:17.480873 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-20fd1e9b-42a7-44bc-bef4-f9cda9d0e481 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:29:17.490751 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-20fd1e9b-42a7-44bc-bef4-f9cda9d0e481 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] [instance: 178b675e-f4d0-442c-aa69-aece6ea3d636] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:29:17.490751 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-20fd1e9b-42a7-44bc-bef4-f9cda9d0e481 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:29:17.490751 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-20fd1e9b-42a7-44bc-bef4-f9cda9d0e481 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:29:17.490751 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-20fd1e9b-42a7-44bc-bef4-f9cda9d0e481 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:29:17.491164 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-20fd1e9b-42a7-44bc-bef4-f9cda9d0e481 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:29:17.625292 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-20fd1e9b-42a7-44bc-bef4-f9cda9d0e481 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8f887f5689419e9e31a0ba43f76ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62d19c831574f9b99c993b5e41c645d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:29:17.641890 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-20fd1e9b-42a7-44bc-bef4-f9cda9d0e481 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] 10.222.0.46 "GET /compute/v2.1/servers/178b675e-f4d0-442c-aa69-aece6ea3d636" status: 200 len: 1724 microversion: 2.1 time: 0.164478 Aug 04 05:29:17.643022 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 228/452] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:29:17 2022] GET /compute/v2.1/servers/178b675e-f4d0-442c-aa69-aece6ea3d636 => generated 1724 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:29:17.727134 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-fdb341a6-31e1-4754-8f29-13be77562ef8 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:29:17.727742 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-fdb341a6-31e1-4754-8f29-13be77562ef8 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] [instance: b45583dc-f18b-4b4a-98e3-ef1bdcf41f80] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:29:17.734330 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-fdb341a6-31e1-4754-8f29-13be77562ef8 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:29:17.734786 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-fdb341a6-31e1-4754-8f29-13be77562ef8 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:29:17.735717 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-fdb341a6-31e1-4754-8f29-13be77562ef8 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:29:17.736148 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-fdb341a6-31e1-4754-8f29-13be77562ef8 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:29:17.905355 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-fdb341a6-31e1-4754-8f29-13be77562ef8 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb49b631c234f9a9fd47049b9b2e097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faead990837d43de8ec54bfaf24361de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:29:17.913415 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-fdb341a6-31e1-4754-8f29-13be77562ef8 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] 10.222.0.46 "GET /compute/v2.1/servers/b45583dc-f18b-4b4a-98e3-ef1bdcf41f80" status: 200 len: 1365 microversion: 2.1 time: 0.190088 Aug 04 05:29:17.914004 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 225/453] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:29:17 2022] GET /compute/v2.1/servers/b45583dc-f18b-4b4a-98e3-ef1bdcf41f80 => generated 1365 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:29:18.668763 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-35ca705d-2d47-4e18-8561-a05606d2d804 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:29:18.669870 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-35ca705d-2d47-4e18-8561-a05606d2d804 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] [instance: 178b675e-f4d0-442c-aa69-aece6ea3d636] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:29:18.682150 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-35ca705d-2d47-4e18-8561-a05606d2d804 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:29:18.682980 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-35ca705d-2d47-4e18-8561-a05606d2d804 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:29:18.683920 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-35ca705d-2d47-4e18-8561-a05606d2d804 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:29:18.684423 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-35ca705d-2d47-4e18-8561-a05606d2d804 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:29:18.838039 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-35ca705d-2d47-4e18-8561-a05606d2d804 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8f887f5689419e9e31a0ba43f76ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62d19c831574f9b99c993b5e41c645d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:29:18.847750 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-35ca705d-2d47-4e18-8561-a05606d2d804 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] 10.222.0.46 "GET /compute/v2.1/servers/178b675e-f4d0-442c-aa69-aece6ea3d636" status: 200 len: 1724 microversion: 2.1 time: 0.186119 Aug 04 05:29:18.848334 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 229/454] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:29:18 2022] GET /compute/v2.1/servers/178b675e-f4d0-442c-aa69-aece6ea3d636 => generated 1724 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:29:18.934662 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-7cb01916-74a5-48ae-97f8-e23dd6938762 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:29:18.935302 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-7cb01916-74a5-48ae-97f8-e23dd6938762 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] [instance: b45583dc-f18b-4b4a-98e3-ef1bdcf41f80] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:29:18.942583 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-7cb01916-74a5-48ae-97f8-e23dd6938762 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:29:18.943031 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-7cb01916-74a5-48ae-97f8-e23dd6938762 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:29:18.943807 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-7cb01916-74a5-48ae-97f8-e23dd6938762 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:29:18.944241 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-7cb01916-74a5-48ae-97f8-e23dd6938762 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:29:19.105039 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-7cb01916-74a5-48ae-97f8-e23dd6938762 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb49b631c234f9a9fd47049b9b2e097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faead990837d43de8ec54bfaf24361de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:29:19.124411 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-7cb01916-74a5-48ae-97f8-e23dd6938762 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] 10.222.0.46 "GET /compute/v2.1/servers/b45583dc-f18b-4b4a-98e3-ef1bdcf41f80" status: 200 len: 1365 microversion: 2.1 time: 0.187596 Aug 04 05:29:19.124411 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 226/455] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:29:18 2022] GET /compute/v2.1/servers/b45583dc-f18b-4b4a-98e3-ef1bdcf41f80 => generated 1365 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:29:19.870961 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-a80a435e-f6ac-487f-be46-8daa3c2b2c73 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:29:19.871797 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-a80a435e-f6ac-487f-be46-8daa3c2b2c73 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] [instance: 178b675e-f4d0-442c-aa69-aece6ea3d636] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:29:19.880127 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-a80a435e-f6ac-487f-be46-8daa3c2b2c73 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:29:19.886228 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-a80a435e-f6ac-487f-be46-8daa3c2b2c73 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:29:19.886228 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-a80a435e-f6ac-487f-be46-8daa3c2b2c73 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:29:19.886228 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-a80a435e-f6ac-487f-be46-8daa3c2b2c73 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:29:20.111414 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-a80a435e-f6ac-487f-be46-8daa3c2b2c73 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8f887f5689419e9e31a0ba43f76ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62d19c831574f9b99c993b5e41c645d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:29:20.120138 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-a80a435e-f6ac-487f-be46-8daa3c2b2c73 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] 10.222.0.46 "GET /compute/v2.1/servers/178b675e-f4d0-442c-aa69-aece6ea3d636" status: 200 len: 1730 microversion: 2.1 time: 0.253132 Aug 04 05:29:20.120735 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 230/456] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:29:19 2022] GET /compute/v2.1/servers/178b675e-f4d0-442c-aa69-aece6ea3d636 => generated 1730 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:29:20.147916 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-cdfe6055-826d-4c0e-b43f-f0b7320328a6 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:29:20.148526 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-cdfe6055-826d-4c0e-b43f-f0b7320328a6 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] [instance: b45583dc-f18b-4b4a-98e3-ef1bdcf41f80] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:29:20.150141 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-5a81ffd5-f5b0-40f8-8e5b-56a3d6e7f82c tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:29:20.150711 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-5a81ffd5-f5b0-40f8-8e5b-56a3d6e7f82c tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] [instance: 178b675e-f4d0-442c-aa69-aece6ea3d636] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:29:20.160978 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-cdfe6055-826d-4c0e-b43f-f0b7320328a6 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:29:20.161443 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-cdfe6055-826d-4c0e-b43f-f0b7320328a6 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:29:20.162252 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-cdfe6055-826d-4c0e-b43f-f0b7320328a6 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:29:20.163131 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-cdfe6055-826d-4c0e-b43f-f0b7320328a6 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:29:20.170029 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-5a81ffd5-f5b0-40f8-8e5b-56a3d6e7f82c tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:29:20.172041 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-5a81ffd5-f5b0-40f8-8e5b-56a3d6e7f82c tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:29:20.172950 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-5a81ffd5-f5b0-40f8-8e5b-56a3d6e7f82c tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:29:20.173388 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-5a81ffd5-f5b0-40f8-8e5b-56a3d6e7f82c tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:29:20.331496 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-5a81ffd5-f5b0-40f8-8e5b-56a3d6e7f82c tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] 10.222.0.46 "GET /compute/v2.1/servers/178b675e-f4d0-442c-aa69-aece6ea3d636/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.186190 Aug 04 05:29:20.332119 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 231/457] 10.222.0.46 () {58 vars in 1275 bytes} [Thu Aug 4 05:29:20 2022] GET /compute/v2.1/servers/178b675e-f4d0-442c-aa69-aece6ea3d636/os-interface => generated 285 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 05:29:20.416842 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-cdfe6055-826d-4c0e-b43f-f0b7320328a6 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb49b631c234f9a9fd47049b9b2e097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faead990837d43de8ec54bfaf24361de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:29:20.426477 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-cdfe6055-826d-4c0e-b43f-f0b7320328a6 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] 10.222.0.46 "GET /compute/v2.1/servers/b45583dc-f18b-4b4a-98e3-ef1bdcf41f80" status: 200 len: 1365 microversion: 2.1 time: 0.287234 Aug 04 05:29:20.427080 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 227/458] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:29:20 2022] GET /compute/v2.1/servers/b45583dc-f18b-4b4a-98e3-ef1bdcf41f80 => generated 1365 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:29:21.349699 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [req-6a6fef42-aacc-4a58-832e-8c413b52b648 req-676ad060-bdd9-4e47-8153-281926b34c2f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b45583dc-f18b-4b4a-98e3-ef1bdcf41f80", "name": "network-vif-plugged", "status": "completed", "tag": "a18f6abd-9021-4bcf-bf94-d461caa21de9"}]} {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:29:21.360597 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [req-6a6fef42-aacc-4a58-832e-8c413b52b648 req-676ad060-bdd9-4e47-8153-281926b34c2f service nova] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:29:21.361289 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [req-6a6fef42-aacc-4a58-832e-8c413b52b648 req-676ad060-bdd9-4e47-8153-281926b34c2f service nova] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:29:21.374509 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.compute.server_external_events [req-6a6fef42-aacc-4a58-832e-8c413b52b648 req-676ad060-bdd9-4e47-8153-281926b34c2f service nova] Creating event network-vif-plugged:a18f6abd-9021-4bcf-bf94-d461caa21de9 for instance b45583dc-f18b-4b4a-98e3-ef1bdcf41f80 on hv-cinder-85207 Aug 04 05:29:21.380858 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [req-6a6fef42-aacc-4a58-832e-8c413b52b648 req-676ad060-bdd9-4e47-8153-281926b34c2f service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035162 Aug 04 05:29:21.381794 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 232/459] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Aug 4 05:29:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:29:21.448356 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-826a7de1-b113-4105-880f-bd26053ab4c8 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:29:21.449148 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-826a7de1-b113-4105-880f-bd26053ab4c8 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] [instance: b45583dc-f18b-4b4a-98e3-ef1bdcf41f80] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:29:21.457010 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-826a7de1-b113-4105-880f-bd26053ab4c8 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:29:21.457561 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-826a7de1-b113-4105-880f-bd26053ab4c8 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:29:21.458428 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-826a7de1-b113-4105-880f-bd26053ab4c8 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:29:21.459081 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-826a7de1-b113-4105-880f-bd26053ab4c8 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:29:21.646201 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-826a7de1-b113-4105-880f-bd26053ab4c8 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb49b631c234f9a9fd47049b9b2e097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faead990837d43de8ec54bfaf24361de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:29:21.653636 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-826a7de1-b113-4105-880f-bd26053ab4c8 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] 10.222.0.46 "GET /compute/v2.1/servers/b45583dc-f18b-4b4a-98e3-ef1bdcf41f80" status: 200 len: 1365 microversion: 2.1 time: 0.209498 Aug 04 05:29:21.654446 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 228/460] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:29:21 2022] GET /compute/v2.1/servers/b45583dc-f18b-4b4a-98e3-ef1bdcf41f80 => generated 1365 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:29:21.704374 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [req-0c96958f-c921-4b07-ace1-3d363a2d5467 req-2cef8687-2ba6-442b-9413-a0e9e4229cb7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "178b675e-f4d0-442c-aa69-aece6ea3d636", "tag": "ea55da7a-e1dc-47c4-9f10-3c184df3b802"}]} {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:29:21.717675 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [req-0c96958f-c921-4b07-ace1-3d363a2d5467 req-2cef8687-2ba6-442b-9413-a0e9e4229cb7 service nova] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:29:21.718201 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [req-0c96958f-c921-4b07-ace1-3d363a2d5467 req-2cef8687-2ba6-442b-9413-a0e9e4229cb7 service nova] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:29:21.739955 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.compute.server_external_events [req-0c96958f-c921-4b07-ace1-3d363a2d5467 req-2cef8687-2ba6-442b-9413-a0e9e4229cb7 service nova] Creating event network-changed:ea55da7a-e1dc-47c4-9f10-3c184df3b802 for instance 178b675e-f4d0-442c-aa69-aece6ea3d636 on hv-cinder-85207 Aug 04 05:29:21.745541 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [req-0c96958f-c921-4b07-ace1-3d363a2d5467 req-2cef8687-2ba6-442b-9413-a0e9e4229cb7 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046493 Aug 04 05:29:21.746870 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 233/461] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Aug 4 05:29:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:29:22.676016 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-3a992247-bfe0-435f-902b-2913af41c6a4 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:29:22.676831 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-3a992247-bfe0-435f-902b-2913af41c6a4 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] [instance: b45583dc-f18b-4b4a-98e3-ef1bdcf41f80] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:29:22.683493 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-3a992247-bfe0-435f-902b-2913af41c6a4 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:29:22.684050 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-3a992247-bfe0-435f-902b-2913af41c6a4 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:29:22.684720 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-3a992247-bfe0-435f-902b-2913af41c6a4 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:29:22.685154 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-3a992247-bfe0-435f-902b-2913af41c6a4 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:29:22.844977 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-3a992247-bfe0-435f-902b-2913af41c6a4 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb49b631c234f9a9fd47049b9b2e097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faead990837d43de8ec54bfaf24361de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:29:22.853788 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-3a992247-bfe0-435f-902b-2913af41c6a4 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] 10.222.0.46 "GET /compute/v2.1/servers/b45583dc-f18b-4b4a-98e3-ef1bdcf41f80" status: 200 len: 1365 microversion: 2.1 time: 0.181840 Aug 04 05:29:22.854402 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 229/462] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:29:22 2022] GET /compute/v2.1/servers/b45583dc-f18b-4b4a-98e3-ef1bdcf41f80 => generated 1365 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:29:22.917054 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-291b7a66-c6dd-402d-9ecb-d23453a7d0b8 tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1700663929", "imageRef": "4613f7d0-37ca-46ad-bb26-dc4990dd7d6f", "flavorRef": "452", "networks": [{"uuid": "65f8e2c1-d62e-4f2c-97e3-127a3a6cd56e"}]}} {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:29:22.976003 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.network.neutron [None req-291b7a66-c6dd-402d-9ecb-d23453a7d0b8 tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] validate_networks() for [('65f8e2c1-d62e-4f2c-97e3-127a3a6cd56e', None, None, None, None, None)] {{(pid=118477) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 05:29:23.342262 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.virt.hardware [None req-291b7a66-c6dd-402d-9ecb-d23453a7d0b8 tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] Flavor limits 0:0:0 {{(pid=118477) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 05:29:23.342779 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.virt.hardware [None req-291b7a66-c6dd-402d-9ecb-d23453a7d0b8 tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] Image limits 0:0:0 {{(pid=118477) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 05:29:23.343259 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.virt.hardware [None req-291b7a66-c6dd-402d-9ecb-d23453a7d0b8 tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] Flavor pref 0:0:0 {{(pid=118477) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 05:29:23.343673 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.virt.hardware [None req-291b7a66-c6dd-402d-9ecb-d23453a7d0b8 tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] Image pref 0:0:0 {{(pid=118477) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 05:29:23.344083 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.virt.hardware [None req-291b7a66-c6dd-402d-9ecb-d23453a7d0b8 tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118477) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 05:29:23.353163 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-291b7a66-c6dd-402d-9ecb-d23453a7d0b8 tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:29:23.353611 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-291b7a66-c6dd-402d-9ecb-d23453a7d0b8 tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:29:23.354446 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-291b7a66-c6dd-402d-9ecb-d23453a7d0b8 tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:29:23.354885 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-291b7a66-c6dd-402d-9ecb-d23453a7d0b8 tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:29:23.372176 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.quota [None req-291b7a66-c6dd-402d-9ecb-d23453a7d0b8 tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] Getting quotas for project 520d3d5e2e804be1bd5dc9bfc50c5de8. Resources: {'instances', 'cores', 'ram'} {{(pid=118477) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 05:29:23.376823 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.quota [None req-291b7a66-c6dd-402d-9ecb-d23453a7d0b8 tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] Getting quotas for user 5af2248451d3483d9742887d614a5077 and project 520d3d5e2e804be1bd5dc9bfc50c5de8. Resources: {'instances', 'cores', 'ram'} {{(pid=118477) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 05:29:23.387700 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-291b7a66-c6dd-402d-9ecb-d23453a7d0b8 tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] Going to run 1 instances... {{(pid=118477) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 05:29:23.390112 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-291b7a66-c6dd-402d-9ecb-d23453a7d0b8 tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] [instance: 4edbad4c-dfb3-43c9-992d-f2b2b4744d94] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4613f7d0-37ca-46ad-bb26-dc4990dd7d6f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118477) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 05:29:23.529344 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-291b7a66-c6dd-402d-9ecb-d23453a7d0b8 tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.617080 Aug 04 05:29:23.530551 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 234/463] 10.222.0.46 () {60 vars in 1147 bytes} [Thu Aug 4 05:29:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 619 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 05:29:23.542551 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-b109a819-bc71-46dc-a523-a2d3a9957783 tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:29:23.543171 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-b109a819-bc71-46dc-a523-a2d3a9957783 tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] [instance: 4edbad4c-dfb3-43c9-992d-f2b2b4744d94] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:29:23.598883 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-b109a819-bc71-46dc-a523-a2d3a9957783 tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5af2248451d3483d9742887d614a5077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520d3d5e2e804be1bd5dc9bfc50c5de8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:29:23.610716 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-b109a819-bc71-46dc-a523-a2d3a9957783 tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] 10.222.0.46 "GET /compute/v2.1/servers/4edbad4c-dfb3-43c9-992d-f2b2b4744d94" status: 200 len: 1219 microversion: 2.1 time: 0.071550 Aug 04 05:29:23.611408 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 230/464] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:29:23 2022] GET /compute/v2.1/servers/4edbad4c-dfb3-43c9-992d-f2b2b4744d94 => generated 1219 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:29:23.762181 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [req-31cd957c-1314-4e21-8b92-ea07a3b183b0 req-fa7ea154-153b-47f1-a963-525e710ee0f4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "178b675e-f4d0-442c-aa69-aece6ea3d636", "tag": "ea55da7a-e1dc-47c4-9f10-3c184df3b802"}]} {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:29:23.774961 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [req-31cd957c-1314-4e21-8b92-ea07a3b183b0 req-fa7ea154-153b-47f1-a963-525e710ee0f4 service nova] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:29:23.775405 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [req-31cd957c-1314-4e21-8b92-ea07a3b183b0 req-fa7ea154-153b-47f1-a963-525e710ee0f4 service nova] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:29:23.789071 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.compute.server_external_events [req-31cd957c-1314-4e21-8b92-ea07a3b183b0 req-fa7ea154-153b-47f1-a963-525e710ee0f4 service nova] Creating event network-changed:ea55da7a-e1dc-47c4-9f10-3c184df3b802 for instance 178b675e-f4d0-442c-aa69-aece6ea3d636 on hv-cinder-85207 Aug 04 05:29:23.794338 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [req-31cd957c-1314-4e21-8b92-ea07a3b183b0 req-fa7ea154-153b-47f1-a963-525e710ee0f4 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035936 Aug 04 05:29:23.794950 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 235/465] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Aug 4 05:29:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:29:23.876220 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-07bd70d8-d7e3-4edb-b4cc-d6e08444fbed tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:29:23.876838 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-07bd70d8-d7e3-4edb-b4cc-d6e08444fbed tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] [instance: b45583dc-f18b-4b4a-98e3-ef1bdcf41f80] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:29:23.884776 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-07bd70d8-d7e3-4edb-b4cc-d6e08444fbed tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:29:23.885273 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-07bd70d8-d7e3-4edb-b4cc-d6e08444fbed tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:29:23.886086 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-07bd70d8-d7e3-4edb-b4cc-d6e08444fbed tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:29:23.886781 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-07bd70d8-d7e3-4edb-b4cc-d6e08444fbed tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:29:23.908561 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG dbcounter [-] [118476] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:29:24.033796 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-07bd70d8-d7e3-4edb-b4cc-d6e08444fbed tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb49b631c234f9a9fd47049b9b2e097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faead990837d43de8ec54bfaf24361de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:29:24.041565 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-07bd70d8-d7e3-4edb-b4cc-d6e08444fbed tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] 10.222.0.46 "GET /compute/v2.1/servers/b45583dc-f18b-4b4a-98e3-ef1bdcf41f80" status: 200 len: 1556 microversion: 2.1 time: 0.169311 Aug 04 05:29:24.042158 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 231/466] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:29:23 2022] GET /compute/v2.1/servers/b45583dc-f18b-4b4a-98e3-ef1bdcf41f80 => generated 1556 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:29:24.069759 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-4e80465d-b6ce-49e9-9f65-af555a59b537 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:29:24.070465 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-4e80465d-b6ce-49e9-9f65-af555a59b537 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] [instance: b45583dc-f18b-4b4a-98e3-ef1bdcf41f80] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:29:24.078196 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-4e80465d-b6ce-49e9-9f65-af555a59b537 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:29:24.078877 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-4e80465d-b6ce-49e9-9f65-af555a59b537 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:29:24.079829 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-4e80465d-b6ce-49e9-9f65-af555a59b537 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:29:24.080270 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-4e80465d-b6ce-49e9-9f65-af555a59b537 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:29:24.185949 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-4e80465d-b6ce-49e9-9f65-af555a59b537 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] 10.222.0.46 "GET /compute/v2.1/servers/b45583dc-f18b-4b4a-98e3-ef1bdcf41f80/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.120603 Aug 04 05:29:24.187267 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 236/467] 10.222.0.46 () {58 vars in 1275 bytes} [Thu Aug 4 05:29:24 2022] GET /compute/v2.1/servers/b45583dc-f18b-4b4a-98e3-ef1bdcf41f80/os-interface => generated 285 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:29:24.633297 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-55300f04-7baa-4446-80aa-e1c85483d722 tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:29:24.633986 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-55300f04-7baa-4446-80aa-e1c85483d722 tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] [instance: 4edbad4c-dfb3-43c9-992d-f2b2b4744d94] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:29:24.690013 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-55300f04-7baa-4446-80aa-e1c85483d722 tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5af2248451d3483d9742887d614a5077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520d3d5e2e804be1bd5dc9bfc50c5de8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:29:24.697386 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-55300f04-7baa-4446-80aa-e1c85483d722 tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] 10.222.0.46 "GET /compute/v2.1/servers/4edbad4c-dfb3-43c9-992d-f2b2b4744d94" status: 200 len: 1219 microversion: 2.1 time: 0.068166 Aug 04 05:29:24.697981 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 232/468] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:29:24 2022] GET /compute/v2.1/servers/4edbad4c-dfb3-43c9-992d-f2b2b4744d94 => generated 1219 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:29:25.719584 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-28623401-f26b-4164-8bda-3c740b85d754 tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:29:25.720196 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-28623401-f26b-4164-8bda-3c740b85d754 tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] [instance: 4edbad4c-dfb3-43c9-992d-f2b2b4744d94] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:29:25.736294 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-28623401-f26b-4164-8bda-3c740b85d754 tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:29:25.736743 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-28623401-f26b-4164-8bda-3c740b85d754 tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:29:25.737526 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-28623401-f26b-4164-8bda-3c740b85d754 tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:29:25.737967 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-28623401-f26b-4164-8bda-3c740b85d754 tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:29:25.807968 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-28623401-f26b-4164-8bda-3c740b85d754 tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5af2248451d3483d9742887d614a5077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520d3d5e2e804be1bd5dc9bfc50c5de8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:29:25.811822 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [req-ca402790-07e5-44d3-8b43-a886019591ad req-fd76b129-55de-4a7e-b81a-418b1b005984 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b45583dc-f18b-4b4a-98e3-ef1bdcf41f80", "tag": "a18f6abd-9021-4bcf-bf94-d461caa21de9"}]} {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:29:25.817206 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-28623401-f26b-4164-8bda-3c740b85d754 tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] 10.222.0.46 "GET /compute/v2.1/servers/4edbad4c-dfb3-43c9-992d-f2b2b4744d94" status: 200 len: 1271 microversion: 2.1 time: 0.102184 Aug 04 05:29:25.818063 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 237/469] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:29:25 2022] GET /compute/v2.1/servers/4edbad4c-dfb3-43c9-992d-f2b2b4744d94 => generated 1271 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:29:25.822823 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [req-ca402790-07e5-44d3-8b43-a886019591ad req-fd76b129-55de-4a7e-b81a-418b1b005984 service nova] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:29:25.823273 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [req-ca402790-07e5-44d3-8b43-a886019591ad req-fd76b129-55de-4a7e-b81a-418b1b005984 service nova] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:29:25.835025 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.compute.server_external_events [req-ca402790-07e5-44d3-8b43-a886019591ad req-fd76b129-55de-4a7e-b81a-418b1b005984 service nova] Creating event network-changed:a18f6abd-9021-4bcf-bf94-d461caa21de9 for instance b45583dc-f18b-4b4a-98e3-ef1bdcf41f80 on hv-cinder-85207 Aug 04 05:29:25.840347 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [req-ca402790-07e5-44d3-8b43-a886019591ad req-fd76b129-55de-4a7e-b81a-418b1b005984 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033138 Aug 04 05:29:25.844527 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 233/470] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Aug 4 05:29:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:29:26.838588 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-5dbe90a3-e2b4-469d-a264-4137d3b7fddc tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:29:26.839217 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-5dbe90a3-e2b4-469d-a264-4137d3b7fddc tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] [instance: 4edbad4c-dfb3-43c9-992d-f2b2b4744d94] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:29:26.848088 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-5dbe90a3-e2b4-469d-a264-4137d3b7fddc tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:29:26.848536 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-5dbe90a3-e2b4-469d-a264-4137d3b7fddc tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:29:26.849319 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-5dbe90a3-e2b4-469d-a264-4137d3b7fddc tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:29:26.849746 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-5dbe90a3-e2b4-469d-a264-4137d3b7fddc tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:29:26.940291 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-5dbe90a3-e2b4-469d-a264-4137d3b7fddc tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5af2248451d3483d9742887d614a5077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520d3d5e2e804be1bd5dc9bfc50c5de8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:29:26.949438 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-5dbe90a3-e2b4-469d-a264-4137d3b7fddc tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] 10.222.0.46 "GET /compute/v2.1/servers/4edbad4c-dfb3-43c9-992d-f2b2b4744d94" status: 200 len: 1277 microversion: 2.1 time: 0.114692 Aug 04 05:29:26.955366 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 238/471] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:29:26 2022] GET /compute/v2.1/servers/4edbad4c-dfb3-43c9-992d-f2b2b4744d94 => generated 1277 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:29:27.973249 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-39b1abe4-71f4-4c9a-9f66-0754ccd845aa tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:29:27.973944 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-39b1abe4-71f4-4c9a-9f66-0754ccd845aa tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] [instance: 4edbad4c-dfb3-43c9-992d-f2b2b4744d94] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:29:27.980137 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-39b1abe4-71f4-4c9a-9f66-0754ccd845aa tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:29:27.980597 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-39b1abe4-71f4-4c9a-9f66-0754ccd845aa tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:29:27.981755 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-39b1abe4-71f4-4c9a-9f66-0754ccd845aa tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:29:27.982591 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-39b1abe4-71f4-4c9a-9f66-0754ccd845aa tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:29:28.129216 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-39b1abe4-71f4-4c9a-9f66-0754ccd845aa tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5af2248451d3483d9742887d614a5077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520d3d5e2e804be1bd5dc9bfc50c5de8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:29:28.136656 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-39b1abe4-71f4-4c9a-9f66-0754ccd845aa tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] 10.222.0.46 "GET /compute/v2.1/servers/4edbad4c-dfb3-43c9-992d-f2b2b4744d94" status: 200 len: 1319 microversion: 2.1 time: 0.168149 Aug 04 05:29:28.137224 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 234/472] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:29:27 2022] GET /compute/v2.1/servers/4edbad4c-dfb3-43c9-992d-f2b2b4744d94 => generated 1319 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:29:28.180324 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [req-6fbd3e0b-84f2-40ff-8725-25bdebc99fbc req-d0d7490a-8029-4c2e-92c2-c41851938178 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4edbad4c-dfb3-43c9-992d-f2b2b4744d94", "tag": "c0fdc862-1ff5-4496-a3e7-a48010e4accf"}]} {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:29:28.191755 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [req-6fbd3e0b-84f2-40ff-8725-25bdebc99fbc req-d0d7490a-8029-4c2e-92c2-c41851938178 service nova] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:29:28.192324 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [req-6fbd3e0b-84f2-40ff-8725-25bdebc99fbc req-d0d7490a-8029-4c2e-92c2-c41851938178 service nova] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:29:28.204133 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.compute.server_external_events [req-6fbd3e0b-84f2-40ff-8725-25bdebc99fbc req-d0d7490a-8029-4c2e-92c2-c41851938178 service nova] Creating event network-changed:c0fdc862-1ff5-4496-a3e7-a48010e4accf for instance 4edbad4c-dfb3-43c9-992d-f2b2b4744d94 on hv-cinder-85207 Aug 04 05:29:28.209051 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [req-6fbd3e0b-84f2-40ff-8725-25bdebc99fbc req-d0d7490a-8029-4c2e-92c2-c41851938178 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032639 Aug 04 05:29:28.209666 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 239/473] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Aug 4 05:29:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:29:29.159910 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-f6b85825-f5d2-4628-a39c-baca8588647a tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:29:29.160522 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-f6b85825-f5d2-4628-a39c-baca8588647a tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] [instance: 4edbad4c-dfb3-43c9-992d-f2b2b4744d94] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:29:29.167562 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-f6b85825-f5d2-4628-a39c-baca8588647a tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:29:29.168059 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-f6b85825-f5d2-4628-a39c-baca8588647a tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:29:29.168782 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-f6b85825-f5d2-4628-a39c-baca8588647a tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:29:29.169217 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-f6b85825-f5d2-4628-a39c-baca8588647a tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:29:29.305541 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-f6b85825-f5d2-4628-a39c-baca8588647a tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5af2248451d3483d9742887d614a5077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520d3d5e2e804be1bd5dc9bfc50c5de8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:29:29.320789 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-f6b85825-f5d2-4628-a39c-baca8588647a tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] 10.222.0.46 "GET /compute/v2.1/servers/4edbad4c-dfb3-43c9-992d-f2b2b4744d94" status: 200 len: 1319 microversion: 2.1 time: 0.166525 Aug 04 05:29:29.321419 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 235/474] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:29:29 2022] GET /compute/v2.1/servers/4edbad4c-dfb3-43c9-992d-f2b2b4744d94 => generated 1319 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:29:30.341982 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-f7c9c475-7534-46da-9f0e-72ea4b9a2fb8 tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:29:30.342727 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-f7c9c475-7534-46da-9f0e-72ea4b9a2fb8 tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] [instance: 4edbad4c-dfb3-43c9-992d-f2b2b4744d94] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:29:30.349091 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-f7c9c475-7534-46da-9f0e-72ea4b9a2fb8 tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:29:30.349532 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-f7c9c475-7534-46da-9f0e-72ea4b9a2fb8 tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:29:30.350286 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-f7c9c475-7534-46da-9f0e-72ea4b9a2fb8 tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:29:30.350749 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-f7c9c475-7534-46da-9f0e-72ea4b9a2fb8 tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:29:30.368423 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG dbcounter [-] [118477] Writing DB stats nova_cell1:SELECT=100 {{(pid=118477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:29:30.481777 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-f7c9c475-7534-46da-9f0e-72ea4b9a2fb8 tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5af2248451d3483d9742887d614a5077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520d3d5e2e804be1bd5dc9bfc50c5de8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:29:30.489530 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-f7c9c475-7534-46da-9f0e-72ea4b9a2fb8 tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] 10.222.0.46 "GET /compute/v2.1/servers/4edbad4c-dfb3-43c9-992d-f2b2b4744d94" status: 200 len: 1319 microversion: 2.1 time: 0.152186 Aug 04 05:29:30.490096 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 240/475] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:29:30 2022] GET /compute/v2.1/servers/4edbad4c-dfb3-43c9-992d-f2b2b4744d94 => generated 1319 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:29:31.510849 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-cf5f2335-9a30-41b8-b01f-35dd1ca1a637 tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:29:31.511409 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-cf5f2335-9a30-41b8-b01f-35dd1ca1a637 tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] [instance: 4edbad4c-dfb3-43c9-992d-f2b2b4744d94] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:29:31.518485 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-cf5f2335-9a30-41b8-b01f-35dd1ca1a637 tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:29:31.518929 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-cf5f2335-9a30-41b8-b01f-35dd1ca1a637 tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:29:31.519693 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-cf5f2335-9a30-41b8-b01f-35dd1ca1a637 tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:29:31.520124 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-cf5f2335-9a30-41b8-b01f-35dd1ca1a637 tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:29:31.653430 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-cf5f2335-9a30-41b8-b01f-35dd1ca1a637 tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5af2248451d3483d9742887d614a5077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520d3d5e2e804be1bd5dc9bfc50c5de8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:29:31.661504 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-cf5f2335-9a30-41b8-b01f-35dd1ca1a637 tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] 10.222.0.46 "GET /compute/v2.1/servers/4edbad4c-dfb3-43c9-992d-f2b2b4744d94" status: 200 len: 1319 microversion: 2.1 time: 0.154549 Aug 04 05:29:31.662074 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 236/476] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:29:31 2022] GET /compute/v2.1/servers/4edbad4c-dfb3-43c9-992d-f2b2b4744d94 => generated 1319 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:29:32.740739 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-be058a46-37f2-4cc6-9304-2930a31a5da5 tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:29:32.741349 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-be058a46-37f2-4cc6-9304-2930a31a5da5 tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] [instance: 4edbad4c-dfb3-43c9-992d-f2b2b4744d94] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:29:32.748031 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-be058a46-37f2-4cc6-9304-2930a31a5da5 tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:29:32.748473 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-be058a46-37f2-4cc6-9304-2930a31a5da5 tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:29:32.749711 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-be058a46-37f2-4cc6-9304-2930a31a5da5 tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:29:32.750262 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-be058a46-37f2-4cc6-9304-2930a31a5da5 tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:29:32.879577 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-be058a46-37f2-4cc6-9304-2930a31a5da5 tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5af2248451d3483d9742887d614a5077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520d3d5e2e804be1bd5dc9bfc50c5de8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:29:32.887063 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-be058a46-37f2-4cc6-9304-2930a31a5da5 tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] 10.222.0.46 "GET /compute/v2.1/servers/4edbad4c-dfb3-43c9-992d-f2b2b4744d94" status: 200 len: 1319 microversion: 2.1 time: 0.150434 Aug 04 05:29:32.887622 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 241/477] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:29:32 2022] GET /compute/v2.1/servers/4edbad4c-dfb3-43c9-992d-f2b2b4744d94 => generated 1319 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:29:33.909618 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-395bbf68-5a0c-4ca3-82c9-81ee8a1a969f tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:29:33.910234 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-395bbf68-5a0c-4ca3-82c9-81ee8a1a969f tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] [instance: 4edbad4c-dfb3-43c9-992d-f2b2b4744d94] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:29:33.919263 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-395bbf68-5a0c-4ca3-82c9-81ee8a1a969f tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:29:33.919711 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-395bbf68-5a0c-4ca3-82c9-81ee8a1a969f tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:29:33.920497 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-395bbf68-5a0c-4ca3-82c9-81ee8a1a969f tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:29:33.922021 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-395bbf68-5a0c-4ca3-82c9-81ee8a1a969f tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:29:34.067502 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-395bbf68-5a0c-4ca3-82c9-81ee8a1a969f tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5af2248451d3483d9742887d614a5077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520d3d5e2e804be1bd5dc9bfc50c5de8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:29:34.074983 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-395bbf68-5a0c-4ca3-82c9-81ee8a1a969f tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] 10.222.0.46 "GET /compute/v2.1/servers/4edbad4c-dfb3-43c9-992d-f2b2b4744d94" status: 200 len: 1319 microversion: 2.1 time: 0.169869 Aug 04 05:29:34.075562 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 237/478] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:29:33 2022] GET /compute/v2.1/servers/4edbad4c-dfb3-43c9-992d-f2b2b4744d94 => generated 1319 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:29:35.098387 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-5dea37d9-669e-4ed1-a24c-6dc7b016bd82 tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:29:35.099044 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-5dea37d9-669e-4ed1-a24c-6dc7b016bd82 tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] [instance: 4edbad4c-dfb3-43c9-992d-f2b2b4744d94] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:29:35.100764 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG dbcounter [-] [118477] Writing DB stats nova_cell0:SELECT=2 {{(pid=118477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:29:35.101429 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG dbcounter [-] [118477] Writing DB stats nova_cell0:SELECT=6 {{(pid=118477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:29:35.106830 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-5dea37d9-669e-4ed1-a24c-6dc7b016bd82 tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:29:35.107270 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-5dea37d9-669e-4ed1-a24c-6dc7b016bd82 tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:29:35.108085 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-5dea37d9-669e-4ed1-a24c-6dc7b016bd82 tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:29:35.108513 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-5dea37d9-669e-4ed1-a24c-6dc7b016bd82 tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:29:35.251022 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-5dea37d9-669e-4ed1-a24c-6dc7b016bd82 tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5af2248451d3483d9742887d614a5077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520d3d5e2e804be1bd5dc9bfc50c5de8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:29:35.258473 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-5dea37d9-669e-4ed1-a24c-6dc7b016bd82 tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] 10.222.0.46 "GET /compute/v2.1/servers/4edbad4c-dfb3-43c9-992d-f2b2b4744d94" status: 200 len: 1319 microversion: 2.1 time: 0.165250 Aug 04 05:29:35.259035 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 242/479] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:29:35 2022] GET /compute/v2.1/servers/4edbad4c-dfb3-43c9-992d-f2b2b4744d94 => generated 1319 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:29:35.387094 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [req-8832377b-6442-4b78-a546-ea4139ebe579 req-77a317f3-97a1-4e40-9e43-f93c127b3119 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4edbad4c-dfb3-43c9-992d-f2b2b4744d94", "name": "network-vif-plugged", "status": "completed", "tag": "c0fdc862-1ff5-4496-a3e7-a48010e4accf"}]} {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:29:35.392266 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG dbcounter [-] [118476] Writing DB stats nova_cell0:SELECT=4 {{(pid=118476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:29:35.392946 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG dbcounter [-] [118476] Writing DB stats nova_api:SELECT=58 {{(pid=118476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:29:35.398360 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [req-8832377b-6442-4b78-a546-ea4139ebe579 req-77a317f3-97a1-4e40-9e43-f93c127b3119 service nova] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:29:35.398933 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [req-8832377b-6442-4b78-a546-ea4139ebe579 req-77a317f3-97a1-4e40-9e43-f93c127b3119 service nova] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:29:35.410747 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.compute.server_external_events [req-8832377b-6442-4b78-a546-ea4139ebe579 req-77a317f3-97a1-4e40-9e43-f93c127b3119 service nova] Creating event network-vif-plugged:c0fdc862-1ff5-4496-a3e7-a48010e4accf for instance 4edbad4c-dfb3-43c9-992d-f2b2b4744d94 on hv-cinder-85207 Aug 04 05:29:35.415499 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [req-8832377b-6442-4b78-a546-ea4139ebe579 req-77a317f3-97a1-4e40-9e43-f93c127b3119 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033235 Aug 04 05:29:35.416092 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 238/480] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Aug 4 05:29:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:29:35.697453 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-b838c09f-fd13-4613-8604-6492650a25a2 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:29:35.697928 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-b838c09f-fd13-4613-8604-6492650a25a2 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] [instance: 9333850c-071c-4330-98b9-84232a752ffe] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:29:35.704808 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-b838c09f-fd13-4613-8604-6492650a25a2 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:29:35.705254 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-b838c09f-fd13-4613-8604-6492650a25a2 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:29:35.706010 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-b838c09f-fd13-4613-8604-6492650a25a2 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:29:35.706480 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-b838c09f-fd13-4613-8604-6492650a25a2 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:29:35.790593 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.objects.instance [None req-b838c09f-fd13-4613-8604-6492650a25a2 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lazy-loading 'services' on Instance uuid 9333850c-071c-4330-98b9-84232a752ffe {{(pid=118477) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 05:29:36.040458 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-b838c09f-fd13-4613-8604-6492650a25a2 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] 10.222.0.46 "DELETE /compute/v2.1/servers/9333850c-071c-4330-98b9-84232a752ffe/os-volume_attachments/cfa2cc95-1cb6-463d-9a1e-1c539936a0af" status: 202 len: 0 microversion: 2.1 time: 0.346850 Aug 04 05:29:36.041051 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 243/481] 10.222.0.46 () {58 vars in 1416 bytes} [Thu Aug 4 05:29:35 2022] DELETE /compute/v2.1/servers/9333850c-071c-4330-98b9-84232a752ffe/os-volume_attachments/cfa2cc95-1cb6-463d-9a1e-1c539936a0af => generated 0 bytes in 348 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 05:29:36.279996 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-3e4749a4-6904-43d9-92ac-5f17bf69ce97 tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:29:36.280676 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-3e4749a4-6904-43d9-92ac-5f17bf69ce97 tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] [instance: 4edbad4c-dfb3-43c9-992d-f2b2b4744d94] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:29:36.288072 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-3e4749a4-6904-43d9-92ac-5f17bf69ce97 tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:29:36.288537 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-3e4749a4-6904-43d9-92ac-5f17bf69ce97 tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:29:36.289291 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-3e4749a4-6904-43d9-92ac-5f17bf69ce97 tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:29:36.289729 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-3e4749a4-6904-43d9-92ac-5f17bf69ce97 tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:29:36.421514 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-3e4749a4-6904-43d9-92ac-5f17bf69ce97 tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5af2248451d3483d9742887d614a5077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520d3d5e2e804be1bd5dc9bfc50c5de8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:29:36.429167 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-3e4749a4-6904-43d9-92ac-5f17bf69ce97 tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] 10.222.0.46 "GET /compute/v2.1/servers/4edbad4c-dfb3-43c9-992d-f2b2b4744d94" status: 200 len: 1319 microversion: 2.1 time: 0.153498 Aug 04 05:29:36.429736 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 239/482] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:29:36 2022] GET /compute/v2.1/servers/4edbad4c-dfb3-43c9-992d-f2b2b4744d94 => generated 1319 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:29:37.451648 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-0626ba11-53a8-4acf-8504-39df78988910 tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:29:37.452792 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-0626ba11-53a8-4acf-8504-39df78988910 tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] [instance: 4edbad4c-dfb3-43c9-992d-f2b2b4744d94] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:29:37.459400 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-0626ba11-53a8-4acf-8504-39df78988910 tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:29:37.459840 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-0626ba11-53a8-4acf-8504-39df78988910 tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:29:37.460586 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-0626ba11-53a8-4acf-8504-39df78988910 tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:29:37.461013 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-0626ba11-53a8-4acf-8504-39df78988910 tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:29:37.595754 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-0626ba11-53a8-4acf-8504-39df78988910 tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5af2248451d3483d9742887d614a5077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520d3d5e2e804be1bd5dc9bfc50c5de8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:29:37.603271 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-0626ba11-53a8-4acf-8504-39df78988910 tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] 10.222.0.46 "GET /compute/v2.1/servers/4edbad4c-dfb3-43c9-992d-f2b2b4744d94" status: 200 len: 1319 microversion: 2.1 time: 0.156544 Aug 04 05:29:37.603841 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 244/483] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:29:37 2022] GET /compute/v2.1/servers/4edbad4c-dfb3-43c9-992d-f2b2b4744d94 => generated 1319 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:29:38.625122 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-8b46610c-4435-4500-a826-197aef01e5e8 tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:29:38.625957 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-8b46610c-4435-4500-a826-197aef01e5e8 tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] [instance: 4edbad4c-dfb3-43c9-992d-f2b2b4744d94] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:29:38.632469 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-8b46610c-4435-4500-a826-197aef01e5e8 tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:29:38.632910 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-8b46610c-4435-4500-a826-197aef01e5e8 tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:29:38.633876 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-8b46610c-4435-4500-a826-197aef01e5e8 tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:29:38.634910 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-8b46610c-4435-4500-a826-197aef01e5e8 tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:29:38.776383 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-8b46610c-4435-4500-a826-197aef01e5e8 tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5af2248451d3483d9742887d614a5077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520d3d5e2e804be1bd5dc9bfc50c5de8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:29:38.784443 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-8b46610c-4435-4500-a826-197aef01e5e8 tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] 10.222.0.46 "GET /compute/v2.1/servers/4edbad4c-dfb3-43c9-992d-f2b2b4744d94" status: 200 len: 1507 microversion: 2.1 time: 0.164068 Aug 04 05:29:38.789102 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 240/484] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:29:38 2022] GET /compute/v2.1/servers/4edbad4c-dfb3-43c9-992d-f2b2b4744d94 => generated 1507 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:29:39.284116 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-0667cb65-6ccf-4a98-b789-6c6b07b39dde tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:29:39.286664 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG dbcounter [-] [118477] Writing DB stats nova_api:SELECT=65,nova_api:INSERT=3 {{(pid=118477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:29:39.291658 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-0667cb65-6ccf-4a98-b789-6c6b07b39dde tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:29:39.292107 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-0667cb65-6ccf-4a98-b789-6c6b07b39dde tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:29:39.316258 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-0667cb65-6ccf-4a98-b789-6c6b07b39dde tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] [instance: 9333850c-071c-4330-98b9-84232a752ffe] Going to try to stop instance {{(pid=118477) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 04 05:29:39.616278 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-0667cb65-6ccf-4a98-b789-6c6b07b39dde tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] 10.222.0.46 "POST /compute/v2.1/servers/9333850c-071c-4330-98b9-84232a752ffe/action" status: 202 len: 0 microversion: 2.1 time: 0.336958 Aug 04 05:29:39.616876 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 245/485] 10.222.0.46 () {60 vars in 1278 bytes} [Thu Aug 4 05:29:39 2022] POST /compute/v2.1/servers/9333850c-071c-4330-98b9-84232a752ffe/action => generated 0 bytes in 338 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 05:29:39.625659 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-be982af9-f7bb-4c2c-a265-2d12a967bd74 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:29:39.626292 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-be982af9-f7bb-4c2c-a265-2d12a967bd74 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] [instance: 9333850c-071c-4330-98b9-84232a752ffe] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:29:39.632918 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-be982af9-f7bb-4c2c-a265-2d12a967bd74 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:29:39.633268 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-be982af9-f7bb-4c2c-a265-2d12a967bd74 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:29:39.634028 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-be982af9-f7bb-4c2c-a265-2d12a967bd74 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:29:39.634503 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-be982af9-f7bb-4c2c-a265-2d12a967bd74 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:29:39.784932 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-be982af9-f7bb-4c2c-a265-2d12a967bd74 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb4dea95659c473b9b193c6234186430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1ca4b83dc874bda9f33e06f4910608c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:29:39.792957 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-be982af9-f7bb-4c2c-a265-2d12a967bd74 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] 10.222.0.46 "GET /compute/v2.1/servers/9333850c-071c-4330-98b9-84232a752ffe" status: 200 len: 1677 microversion: 2.1 time: 0.171752 Aug 04 05:29:39.793745 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 241/486] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:29:39 2022] GET /compute/v2.1/servers/9333850c-071c-4330-98b9-84232a752ffe => generated 1677 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:29:40.815444 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-49f5d4b3-8755-4331-ac0a-0122fb8873c2 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:29:40.816152 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-49f5d4b3-8755-4331-ac0a-0122fb8873c2 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] [instance: 9333850c-071c-4330-98b9-84232a752ffe] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:29:40.822395 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-49f5d4b3-8755-4331-ac0a-0122fb8873c2 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:29:40.822845 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-49f5d4b3-8755-4331-ac0a-0122fb8873c2 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:29:40.823610 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-49f5d4b3-8755-4331-ac0a-0122fb8873c2 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:29:40.824050 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-49f5d4b3-8755-4331-ac0a-0122fb8873c2 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:29:40.969901 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-49f5d4b3-8755-4331-ac0a-0122fb8873c2 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb4dea95659c473b9b193c6234186430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1ca4b83dc874bda9f33e06f4910608c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:29:40.977474 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-49f5d4b3-8755-4331-ac0a-0122fb8873c2 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] 10.222.0.46 "GET /compute/v2.1/servers/9333850c-071c-4330-98b9-84232a752ffe" status: 200 len: 1677 microversion: 2.1 time: 0.167522 Aug 04 05:29:40.977978 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 246/487] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:29:40 2022] GET /compute/v2.1/servers/9333850c-071c-4330-98b9-84232a752ffe => generated 1677 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:29:42.000241 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-52277c63-2bf8-4825-a8b1-b31052467e1d tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:29:42.000847 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-52277c63-2bf8-4825-a8b1-b31052467e1d tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] [instance: 9333850c-071c-4330-98b9-84232a752ffe] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:29:42.007586 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-52277c63-2bf8-4825-a8b1-b31052467e1d tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:29:42.008051 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-52277c63-2bf8-4825-a8b1-b31052467e1d tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:29:42.008855 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-52277c63-2bf8-4825-a8b1-b31052467e1d tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:29:42.009292 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-52277c63-2bf8-4825-a8b1-b31052467e1d tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:29:42.146903 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-52277c63-2bf8-4825-a8b1-b31052467e1d tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb4dea95659c473b9b193c6234186430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1ca4b83dc874bda9f33e06f4910608c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:29:42.154482 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-52277c63-2bf8-4825-a8b1-b31052467e1d tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] 10.222.0.46 "GET /compute/v2.1/servers/9333850c-071c-4330-98b9-84232a752ffe" status: 200 len: 1677 microversion: 2.1 time: 0.158655 Aug 04 05:29:42.155059 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 242/488] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:29:41 2022] GET /compute/v2.1/servers/9333850c-071c-4330-98b9-84232a752ffe => generated 1677 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:29:43.178022 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-99aa2816-583a-4c0f-bd6f-6ce75306d129 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:29:43.178945 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-99aa2816-583a-4c0f-bd6f-6ce75306d129 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] [instance: 9333850c-071c-4330-98b9-84232a752ffe] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:29:43.192004 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-99aa2816-583a-4c0f-bd6f-6ce75306d129 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:29:43.192574 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-99aa2816-583a-4c0f-bd6f-6ce75306d129 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:29:43.193673 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-99aa2816-583a-4c0f-bd6f-6ce75306d129 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:29:43.194119 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-99aa2816-583a-4c0f-bd6f-6ce75306d129 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:29:43.326648 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-99aa2816-583a-4c0f-bd6f-6ce75306d129 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb4dea95659c473b9b193c6234186430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1ca4b83dc874bda9f33e06f4910608c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:29:43.334931 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-99aa2816-583a-4c0f-bd6f-6ce75306d129 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] 10.222.0.46 "GET /compute/v2.1/servers/9333850c-071c-4330-98b9-84232a752ffe" status: 200 len: 1677 microversion: 2.1 time: 0.162520 Aug 04 05:29:43.335488 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 247/489] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:29:43 2022] GET /compute/v2.1/servers/9333850c-071c-4330-98b9-84232a752ffe => generated 1677 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 05:29:44.356617 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-e9b42ada-1d23-4db8-a112-d61ebd2ffe0c tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:29:44.357252 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-e9b42ada-1d23-4db8-a112-d61ebd2ffe0c tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] [instance: 9333850c-071c-4330-98b9-84232a752ffe] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:29:44.364534 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-e9b42ada-1d23-4db8-a112-d61ebd2ffe0c tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:29:44.364972 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-e9b42ada-1d23-4db8-a112-d61ebd2ffe0c tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:29:44.365810 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-e9b42ada-1d23-4db8-a112-d61ebd2ffe0c tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:29:44.366151 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-e9b42ada-1d23-4db8-a112-d61ebd2ffe0c tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:29:44.500891 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-e9b42ada-1d23-4db8-a112-d61ebd2ffe0c tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb4dea95659c473b9b193c6234186430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1ca4b83dc874bda9f33e06f4910608c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:29:44.508368 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-e9b42ada-1d23-4db8-a112-d61ebd2ffe0c tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] 10.222.0.46 "GET /compute/v2.1/servers/9333850c-071c-4330-98b9-84232a752ffe" status: 200 len: 1677 microversion: 2.1 time: 0.155662 Aug 04 05:29:44.508947 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 243/490] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:29:44 2022] GET /compute/v2.1/servers/9333850c-071c-4330-98b9-84232a752ffe => generated 1677 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:29:45.534570 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-cdfd6d28-2a6e-4551-b146-bd4185ae8c92 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:29:45.535162 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-cdfd6d28-2a6e-4551-b146-bd4185ae8c92 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] [instance: 9333850c-071c-4330-98b9-84232a752ffe] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:29:45.541730 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-cdfd6d28-2a6e-4551-b146-bd4185ae8c92 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:29:45.542374 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-cdfd6d28-2a6e-4551-b146-bd4185ae8c92 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:29:45.543138 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-cdfd6d28-2a6e-4551-b146-bd4185ae8c92 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:29:45.543565 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-cdfd6d28-2a6e-4551-b146-bd4185ae8c92 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:29:45.675729 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-cdfd6d28-2a6e-4551-b146-bd4185ae8c92 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb4dea95659c473b9b193c6234186430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1ca4b83dc874bda9f33e06f4910608c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:29:45.683123 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-cdfd6d28-2a6e-4551-b146-bd4185ae8c92 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] 10.222.0.46 "GET /compute/v2.1/servers/9333850c-071c-4330-98b9-84232a752ffe" status: 200 len: 1677 microversion: 2.1 time: 0.153746 Aug 04 05:29:45.683687 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 248/491] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:29:45 2022] GET /compute/v2.1/servers/9333850c-071c-4330-98b9-84232a752ffe => generated 1677 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:29:46.703911 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-7476a71a-5d40-4d4b-bf92-2a90dee9a8de tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:29:46.704536 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-7476a71a-5d40-4d4b-bf92-2a90dee9a8de tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] [instance: 9333850c-071c-4330-98b9-84232a752ffe] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:29:46.711322 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-7476a71a-5d40-4d4b-bf92-2a90dee9a8de tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:29:46.711766 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-7476a71a-5d40-4d4b-bf92-2a90dee9a8de tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:29:46.712534 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-7476a71a-5d40-4d4b-bf92-2a90dee9a8de tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:29:46.712964 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-7476a71a-5d40-4d4b-bf92-2a90dee9a8de tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:29:46.854218 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-7476a71a-5d40-4d4b-bf92-2a90dee9a8de tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb4dea95659c473b9b193c6234186430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1ca4b83dc874bda9f33e06f4910608c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:29:46.866408 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-7476a71a-5d40-4d4b-bf92-2a90dee9a8de tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] 10.222.0.46 "GET /compute/v2.1/servers/9333850c-071c-4330-98b9-84232a752ffe" status: 200 len: 1677 microversion: 2.1 time: 0.166267 Aug 04 05:29:46.867061 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 244/492] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:29:46 2022] GET /compute/v2.1/servers/9333850c-071c-4330-98b9-84232a752ffe => generated 1677 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:29:47.889509 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-a5e96223-32c9-4705-bf5d-f4387d8b0753 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:29:47.890120 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-a5e96223-32c9-4705-bf5d-f4387d8b0753 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] [instance: 9333850c-071c-4330-98b9-84232a752ffe] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:29:47.896646 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-a5e96223-32c9-4705-bf5d-f4387d8b0753 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:29:47.897086 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-a5e96223-32c9-4705-bf5d-f4387d8b0753 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:29:47.897839 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-a5e96223-32c9-4705-bf5d-f4387d8b0753 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:29:47.898266 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-a5e96223-32c9-4705-bf5d-f4387d8b0753 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:29:48.283126 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-a5e96223-32c9-4705-bf5d-f4387d8b0753 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb4dea95659c473b9b193c6234186430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1ca4b83dc874bda9f33e06f4910608c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:29:48.290550 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-a5e96223-32c9-4705-bf5d-f4387d8b0753 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] 10.222.0.46 "GET /compute/v2.1/servers/9333850c-071c-4330-98b9-84232a752ffe" status: 200 len: 1677 microversion: 2.1 time: 0.405550 Aug 04 05:29:48.291127 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 249/493] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:29:47 2022] GET /compute/v2.1/servers/9333850c-071c-4330-98b9-84232a752ffe => generated 1677 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:29:49.312727 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-e7541cb2-e7d0-4ccd-85c2-ae235050be9b tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:29:49.313352 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-e7541cb2-e7d0-4ccd-85c2-ae235050be9b tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] [instance: 9333850c-071c-4330-98b9-84232a752ffe] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:29:49.323260 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-e7541cb2-e7d0-4ccd-85c2-ae235050be9b tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:29:49.323714 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-e7541cb2-e7d0-4ccd-85c2-ae235050be9b tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:29:49.324487 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-e7541cb2-e7d0-4ccd-85c2-ae235050be9b tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:29:49.324933 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-e7541cb2-e7d0-4ccd-85c2-ae235050be9b tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:29:49.455984 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-e7541cb2-e7d0-4ccd-85c2-ae235050be9b tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb4dea95659c473b9b193c6234186430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1ca4b83dc874bda9f33e06f4910608c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:29:49.463475 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-e7541cb2-e7d0-4ccd-85c2-ae235050be9b tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] 10.222.0.46 "GET /compute/v2.1/servers/9333850c-071c-4330-98b9-84232a752ffe" status: 200 len: 1677 microversion: 2.1 time: 0.154746 Aug 04 05:29:49.464044 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 245/494] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:29:49 2022] GET /compute/v2.1/servers/9333850c-071c-4330-98b9-84232a752ffe => generated 1677 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:29:50.485633 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-6d14ab5f-46af-4920-8afa-d79dd1863dd8 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:29:50.486241 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-6d14ab5f-46af-4920-8afa-d79dd1863dd8 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] [instance: 9333850c-071c-4330-98b9-84232a752ffe] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:29:50.492790 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-6d14ab5f-46af-4920-8afa-d79dd1863dd8 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:29:50.498680 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-6d14ab5f-46af-4920-8afa-d79dd1863dd8 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:29:50.498680 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-6d14ab5f-46af-4920-8afa-d79dd1863dd8 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:29:50.498680 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-6d14ab5f-46af-4920-8afa-d79dd1863dd8 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:29:50.635991 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-6d14ab5f-46af-4920-8afa-d79dd1863dd8 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb4dea95659c473b9b193c6234186430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1ca4b83dc874bda9f33e06f4910608c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:29:50.644505 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-6d14ab5f-46af-4920-8afa-d79dd1863dd8 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] 10.222.0.46 "GET /compute/v2.1/servers/9333850c-071c-4330-98b9-84232a752ffe" status: 200 len: 1654 microversion: 2.1 time: 0.162894 Aug 04 05:29:50.645040 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 250/495] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:29:50 2022] GET /compute/v2.1/servers/9333850c-071c-4330-98b9-84232a752ffe => generated 1654 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:29:50.666686 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-ee395794-34ee-44ab-9133-c1029e4469fe tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:29:50.674216 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-ee395794-34ee-44ab-9133-c1029e4469fe tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:29:50.674705 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-ee395794-34ee-44ab-9133-c1029e4469fe tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:29:50.698375 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-ee395794-34ee-44ab-9133-c1029e4469fe tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] [instance: 9333850c-071c-4330-98b9-84232a752ffe] Going to try to start instance {{(pid=118476) start /opt/stack/nova/nova/compute/api.py:2732}} Aug 04 05:29:50.976061 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-ee395794-34ee-44ab-9133-c1029e4469fe tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] 10.222.0.46 "POST /compute/v2.1/servers/9333850c-071c-4330-98b9-84232a752ffe/action" status: 202 len: 0 microversion: 2.1 time: 0.313504 Aug 04 05:29:50.976710 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 246/496] 10.222.0.46 () {60 vars in 1278 bytes} [Thu Aug 4 05:29:50 2022] POST /compute/v2.1/servers/9333850c-071c-4330-98b9-84232a752ffe/action => generated 0 bytes in 315 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 05:29:50.985713 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-288249dd-c7d2-46c5-b7d3-cf6d1299e71d tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:29:50.986378 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-288249dd-c7d2-46c5-b7d3-cf6d1299e71d tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] [instance: 9333850c-071c-4330-98b9-84232a752ffe] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:29:50.992605 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-288249dd-c7d2-46c5-b7d3-cf6d1299e71d tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:29:50.993059 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-288249dd-c7d2-46c5-b7d3-cf6d1299e71d tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:29:50.993845 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-288249dd-c7d2-46c5-b7d3-cf6d1299e71d tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:29:50.994285 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-288249dd-c7d2-46c5-b7d3-cf6d1299e71d tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:29:51.136817 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-288249dd-c7d2-46c5-b7d3-cf6d1299e71d tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb4dea95659c473b9b193c6234186430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1ca4b83dc874bda9f33e06f4910608c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:29:51.144597 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-288249dd-c7d2-46c5-b7d3-cf6d1299e71d tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] 10.222.0.46 "GET /compute/v2.1/servers/9333850c-071c-4330-98b9-84232a752ffe" status: 200 len: 1663 microversion: 2.1 time: 0.163480 Aug 04 05:29:51.145165 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 251/497] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:29:50 2022] GET /compute/v2.1/servers/9333850c-071c-4330-98b9-84232a752ffe => generated 1663 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:29:52.167220 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-76dfbe01-2616-47ff-89ad-b6876a0f6c87 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:29:52.167957 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-76dfbe01-2616-47ff-89ad-b6876a0f6c87 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] [instance: 9333850c-071c-4330-98b9-84232a752ffe] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:29:52.175067 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-76dfbe01-2616-47ff-89ad-b6876a0f6c87 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:29:52.175435 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-76dfbe01-2616-47ff-89ad-b6876a0f6c87 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:29:52.176162 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-76dfbe01-2616-47ff-89ad-b6876a0f6c87 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:29:52.176600 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-76dfbe01-2616-47ff-89ad-b6876a0f6c87 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:29:52.312126 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-76dfbe01-2616-47ff-89ad-b6876a0f6c87 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb4dea95659c473b9b193c6234186430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1ca4b83dc874bda9f33e06f4910608c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:29:52.319908 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-76dfbe01-2616-47ff-89ad-b6876a0f6c87 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] 10.222.0.46 "GET /compute/v2.1/servers/9333850c-071c-4330-98b9-84232a752ffe" status: 200 len: 1663 microversion: 2.1 time: 0.157725 Aug 04 05:29:52.320495 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 247/498] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:29:52 2022] GET /compute/v2.1/servers/9333850c-071c-4330-98b9-84232a752ffe => generated 1663 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:29:53.343035 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-bef5a1eb-a047-4a0c-9813-edc40a481564 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:29:53.343562 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-bef5a1eb-a047-4a0c-9813-edc40a481564 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] [instance: 9333850c-071c-4330-98b9-84232a752ffe] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:29:53.350066 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-bef5a1eb-a047-4a0c-9813-edc40a481564 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:29:53.350548 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-bef5a1eb-a047-4a0c-9813-edc40a481564 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:29:53.351317 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-bef5a1eb-a047-4a0c-9813-edc40a481564 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:29:53.351763 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-bef5a1eb-a047-4a0c-9813-edc40a481564 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:29:53.500477 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-bef5a1eb-a047-4a0c-9813-edc40a481564 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb4dea95659c473b9b193c6234186430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1ca4b83dc874bda9f33e06f4910608c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:29:53.508065 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-bef5a1eb-a047-4a0c-9813-edc40a481564 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] 10.222.0.46 "GET /compute/v2.1/servers/9333850c-071c-4330-98b9-84232a752ffe" status: 200 len: 1667 microversion: 2.1 time: 0.169562 Aug 04 05:29:53.508644 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 252/499] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:29:53 2022] GET /compute/v2.1/servers/9333850c-071c-4330-98b9-84232a752ffe => generated 1667 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:29:57.703613 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-e4445585-c06c-4871-b78a-9ed0b98e7174 tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ccc80c65-f8f3-44aa-83e7-d3925721ae4a", "device": "/dev/sdb"}} {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:29:57.706487 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-e4445585-c06c-4871-b78a-9ed0b98e7174 tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] [instance: 4edbad4c-dfb3-43c9-992d-f2b2b4744d94] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:29:57.713347 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-e4445585-c06c-4871-b78a-9ed0b98e7174 tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:29:57.713800 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-e4445585-c06c-4871-b78a-9ed0b98e7174 tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:29:57.714609 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-e4445585-c06c-4871-b78a-9ed0b98e7174 tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:29:57.715046 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-e4445585-c06c-4871-b78a-9ed0b98e7174 tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:29:57.718354 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG dbcounter [-] [118476] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:29:58.612020 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-e4445585-c06c-4871-b78a-9ed0b98e7174 tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] 10.222.0.46 "POST /compute/v2.1/servers/4edbad4c-dfb3-43c9-992d-f2b2b4744d94/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.912686 Aug 04 05:29:58.612648 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 248/500] 10.222.0.46 () {60 vars in 1323 bytes} [Thu Aug 4 05:29:57 2022] POST /compute/v2.1/servers/4edbad4c-dfb3-43c9-992d-f2b2b4744d94/os-volume_attachments => generated 194 bytes in 915 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:30:00.551551 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-b7232bdf-280e-4dd4-8581-e633a8a202c0 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:30:00.552173 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-b7232bdf-280e-4dd4-8581-e633a8a202c0 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] [instance: 178b675e-f4d0-442c-aa69-aece6ea3d636] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:30:00.559984 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-b7232bdf-280e-4dd4-8581-e633a8a202c0 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:30:00.560455 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-b7232bdf-280e-4dd4-8581-e633a8a202c0 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:30:00.565472 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-b7232bdf-280e-4dd4-8581-e633a8a202c0 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:30:00.565472 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-b7232bdf-280e-4dd4-8581-e633a8a202c0 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:30:00.565472 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG dbcounter [-] [118477] Writing DB stats nova_cell1:SELECT=82,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=118477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:30:00.650546 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.objects.instance [None req-b7232bdf-280e-4dd4-8581-e633a8a202c0 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lazy-loading 'services' on Instance uuid 178b675e-f4d0-442c-aa69-aece6ea3d636 {{(pid=118477) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 05:30:00.869004 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-b7232bdf-280e-4dd4-8581-e633a8a202c0 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] 10.222.0.46 "DELETE /compute/v2.1/servers/178b675e-f4d0-442c-aa69-aece6ea3d636/os-volume_attachments/76829b8a-2bf6-4ac0-9484-92fae22049e3" status: 202 len: 0 microversion: 2.1 time: 0.321997 Aug 04 05:30:00.869597 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 253/501] 10.222.0.46 () {58 vars in 1416 bytes} [Thu Aug 4 05:30:00 2022] DELETE /compute/v2.1/servers/178b675e-f4d0-442c-aa69-aece6ea3d636/os-volume_attachments/76829b8a-2bf6-4ac0-9484-92fae22049e3 => generated 0 bytes in 324 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 05:30:00.879098 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-cba20e53-f8d8-4bae-bbcb-e1571a0453ff tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:30:00.881471 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-cba20e53-f8d8-4bae-bbcb-e1571a0453ff tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] [instance: 178b675e-f4d0-442c-aa69-aece6ea3d636] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:30:00.888385 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-cba20e53-f8d8-4bae-bbcb-e1571a0453ff tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:30:00.888826 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-cba20e53-f8d8-4bae-bbcb-e1571a0453ff tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:30:00.889588 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-cba20e53-f8d8-4bae-bbcb-e1571a0453ff tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:30:00.890418 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-cba20e53-f8d8-4bae-bbcb-e1571a0453ff tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:30:00.929333 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-cba20e53-f8d8-4bae-bbcb-e1571a0453ff tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] 10.222.0.46 "GET /compute/v2.1/servers/178b675e-f4d0-442c-aa69-aece6ea3d636/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054695 Aug 04 05:30:00.929912 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 249/502] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Aug 4 05:30:00 2022] GET /compute/v2.1/servers/178b675e-f4d0-442c-aa69-aece6ea3d636/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:30:01.943448 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-9562adad-6d1c-4ac5-bf21-dc5ceda56155 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:30:01.945893 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-9562adad-6d1c-4ac5-bf21-dc5ceda56155 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] [instance: 178b675e-f4d0-442c-aa69-aece6ea3d636] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:30:01.952314 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-9562adad-6d1c-4ac5-bf21-dc5ceda56155 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:30:01.952755 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-9562adad-6d1c-4ac5-bf21-dc5ceda56155 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:30:01.954078 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-9562adad-6d1c-4ac5-bf21-dc5ceda56155 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:30:01.954882 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-9562adad-6d1c-4ac5-bf21-dc5ceda56155 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:30:01.984623 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-9562adad-6d1c-4ac5-bf21-dc5ceda56155 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] 10.222.0.46 "GET /compute/v2.1/servers/178b675e-f4d0-442c-aa69-aece6ea3d636/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047007 Aug 04 05:30:01.985515 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 254/503] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Aug 4 05:30:01 2022] GET /compute/v2.1/servers/178b675e-f4d0-442c-aa69-aece6ea3d636/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:30:02.997654 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-7dbedd4a-5144-4ea9-b1f2-b5dcb44426a7 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:30:02.999837 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-7dbedd4a-5144-4ea9-b1f2-b5dcb44426a7 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] [instance: 178b675e-f4d0-442c-aa69-aece6ea3d636] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:30:03.007061 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-7dbedd4a-5144-4ea9-b1f2-b5dcb44426a7 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:30:03.007511 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-7dbedd4a-5144-4ea9-b1f2-b5dcb44426a7 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:30:03.008282 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-7dbedd4a-5144-4ea9-b1f2-b5dcb44426a7 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:30:03.008724 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-7dbedd4a-5144-4ea9-b1f2-b5dcb44426a7 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:30:03.039035 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-7dbedd4a-5144-4ea9-b1f2-b5dcb44426a7 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] 10.222.0.46 "GET /compute/v2.1/servers/178b675e-f4d0-442c-aa69-aece6ea3d636/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045549 Aug 04 05:30:03.039629 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 250/504] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Aug 4 05:30:02 2022] GET /compute/v2.1/servers/178b675e-f4d0-442c-aa69-aece6ea3d636/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:30:04.051063 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-b3e23e59-20e0-48fb-a5c6-46989f5f323f tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:30:04.053194 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-b3e23e59-20e0-48fb-a5c6-46989f5f323f tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] [instance: 178b675e-f4d0-442c-aa69-aece6ea3d636] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:30:04.059629 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-b3e23e59-20e0-48fb-a5c6-46989f5f323f tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:30:04.060077 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-b3e23e59-20e0-48fb-a5c6-46989f5f323f tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:30:04.060830 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-b3e23e59-20e0-48fb-a5c6-46989f5f323f tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:30:04.061262 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-b3e23e59-20e0-48fb-a5c6-46989f5f323f tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:30:04.090556 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-b3e23e59-20e0-48fb-a5c6-46989f5f323f tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] 10.222.0.46 "GET /compute/v2.1/servers/178b675e-f4d0-442c-aa69-aece6ea3d636/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043341 Aug 04 05:30:04.091109 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 255/505] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Aug 4 05:30:04 2022] GET /compute/v2.1/servers/178b675e-f4d0-442c-aa69-aece6ea3d636/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:30:05.103603 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-e58c1e72-0b54-4ebe-b35e-a434416b7d7d tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:30:05.105815 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-e58c1e72-0b54-4ebe-b35e-a434416b7d7d tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] [instance: 178b675e-f4d0-442c-aa69-aece6ea3d636] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:30:05.113119 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-e58c1e72-0b54-4ebe-b35e-a434416b7d7d tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:30:05.113681 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-e58c1e72-0b54-4ebe-b35e-a434416b7d7d tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:30:05.114488 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-e58c1e72-0b54-4ebe-b35e-a434416b7d7d tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:30:05.114924 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-e58c1e72-0b54-4ebe-b35e-a434416b7d7d tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:30:05.144406 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-e58c1e72-0b54-4ebe-b35e-a434416b7d7d tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] 10.222.0.46 "GET /compute/v2.1/servers/178b675e-f4d0-442c-aa69-aece6ea3d636/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044740 Aug 04 05:30:05.144971 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 251/506] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Aug 4 05:30:05 2022] GET /compute/v2.1/servers/178b675e-f4d0-442c-aa69-aece6ea3d636/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:30:06.157200 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-563d30a7-f04e-4a10-b312-ca474a117949 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:30:06.160938 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-563d30a7-f04e-4a10-b312-ca474a117949 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] [instance: 178b675e-f4d0-442c-aa69-aece6ea3d636] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:30:06.167543 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-563d30a7-f04e-4a10-b312-ca474a117949 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:30:06.167980 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-563d30a7-f04e-4a10-b312-ca474a117949 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:30:06.168835 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-563d30a7-f04e-4a10-b312-ca474a117949 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:30:06.169150 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-563d30a7-f04e-4a10-b312-ca474a117949 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:30:06.200340 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-563d30a7-f04e-4a10-b312-ca474a117949 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] 10.222.0.46 "GET /compute/v2.1/servers/178b675e-f4d0-442c-aa69-aece6ea3d636/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047510 Aug 04 05:30:06.200923 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 256/507] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Aug 4 05:30:06 2022] GET /compute/v2.1/servers/178b675e-f4d0-442c-aa69-aece6ea3d636/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:30:07.212570 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-1b21230c-8cad-4d03-977a-f3db86c194da tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:30:07.214751 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-1b21230c-8cad-4d03-977a-f3db86c194da tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] [instance: 178b675e-f4d0-442c-aa69-aece6ea3d636] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:30:07.217116 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG dbcounter [-] [118476] Writing DB stats nova_api:SELECT=28 {{(pid=118476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:30:07.221793 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-1b21230c-8cad-4d03-977a-f3db86c194da tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:30:07.222907 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-1b21230c-8cad-4d03-977a-f3db86c194da tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:30:07.223741 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-1b21230c-8cad-4d03-977a-f3db86c194da tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:30:07.224118 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-1b21230c-8cad-4d03-977a-f3db86c194da tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:30:07.255626 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-1b21230c-8cad-4d03-977a-f3db86c194da tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] 10.222.0.46 "GET /compute/v2.1/servers/178b675e-f4d0-442c-aa69-aece6ea3d636/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047096 Aug 04 05:30:07.256407 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 252/508] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Aug 4 05:30:07 2022] GET /compute/v2.1/servers/178b675e-f4d0-442c-aa69-aece6ea3d636/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:30:08.267987 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-f33529ff-16ef-4736-90d6-0af6a1625523 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:30:08.270176 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-f33529ff-16ef-4736-90d6-0af6a1625523 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] [instance: 178b675e-f4d0-442c-aa69-aece6ea3d636] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:30:08.276719 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-f33529ff-16ef-4736-90d6-0af6a1625523 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:30:08.277157 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-f33529ff-16ef-4736-90d6-0af6a1625523 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:30:08.277951 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-f33529ff-16ef-4736-90d6-0af6a1625523 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:30:08.278446 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-f33529ff-16ef-4736-90d6-0af6a1625523 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:30:08.308219 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-f33529ff-16ef-4736-90d6-0af6a1625523 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] 10.222.0.46 "GET /compute/v2.1/servers/178b675e-f4d0-442c-aa69-aece6ea3d636/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044140 Aug 04 05:30:08.308782 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 257/509] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Aug 4 05:30:08 2022] GET /compute/v2.1/servers/178b675e-f4d0-442c-aa69-aece6ea3d636/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 05:30:08.385166 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-b64a8b23-d000-4199-91b8-e01296d1b51f tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:30:08.385726 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-b64a8b23-d000-4199-91b8-e01296d1b51f tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] [instance: 178b675e-f4d0-442c-aa69-aece6ea3d636] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:30:08.392245 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-b64a8b23-d000-4199-91b8-e01296d1b51f tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:30:08.392696 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-b64a8b23-d000-4199-91b8-e01296d1b51f tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:30:08.393457 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-b64a8b23-d000-4199-91b8-e01296d1b51f tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:30:08.393891 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-b64a8b23-d000-4199-91b8-e01296d1b51f tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:30:08.421210 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-b64a8b23-d000-4199-91b8-e01296d1b51f tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] [instance: 178b675e-f4d0-442c-aa69-aece6ea3d636] Going to try to terminate instance {{(pid=118476) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 05:30:08.720686 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-b64a8b23-d000-4199-91b8-e01296d1b51f tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] 10.222.0.46 "DELETE /compute/v2.1/servers/178b675e-f4d0-442c-aa69-aece6ea3d636" status: 204 len: 0 microversion: 2.1 time: 0.339038 Aug 04 05:30:08.721198 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 253/510] 10.222.0.46 () {58 vars in 1239 bytes} [Thu Aug 4 05:30:08 2022] DELETE /compute/v2.1/servers/178b675e-f4d0-442c-aa69-aece6ea3d636 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 05:30:08.730596 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-38eabad2-cb60-431e-b72c-ecba0b1492f7 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:30:08.734172 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-38eabad2-cb60-431e-b72c-ecba0b1492f7 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] [instance: 178b675e-f4d0-442c-aa69-aece6ea3d636] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:30:08.737191 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-38eabad2-cb60-431e-b72c-ecba0b1492f7 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:30:08.737685 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-38eabad2-cb60-431e-b72c-ecba0b1492f7 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:30:08.739134 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-38eabad2-cb60-431e-b72c-ecba0b1492f7 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:30:08.739567 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-38eabad2-cb60-431e-b72c-ecba0b1492f7 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:30:09.000386 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-38eabad2-cb60-431e-b72c-ecba0b1492f7 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8f887f5689419e9e31a0ba43f76ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62d19c831574f9b99c993b5e41c645d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:30:09.008854 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-38eabad2-cb60-431e-b72c-ecba0b1492f7 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] 10.222.0.46 "GET /compute/v2.1/servers/178b675e-f4d0-442c-aa69-aece6ea3d636" status: 200 len: 1690 microversion: 2.1 time: 0.282232 Aug 04 05:30:09.009427 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 258/511] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:30:08 2022] GET /compute/v2.1/servers/178b675e-f4d0-442c-aa69-aece6ea3d636 => generated 1690 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:30:10.032276 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-31aebfe5-aea6-4fe0-a92d-11778bd10cf4 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:30:10.032919 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-31aebfe5-aea6-4fe0-a92d-11778bd10cf4 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] [instance: 178b675e-f4d0-442c-aa69-aece6ea3d636] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:30:10.040993 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-31aebfe5-aea6-4fe0-a92d-11778bd10cf4 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:30:10.041435 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-31aebfe5-aea6-4fe0-a92d-11778bd10cf4 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:30:10.042190 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-31aebfe5-aea6-4fe0-a92d-11778bd10cf4 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:30:10.042646 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-31aebfe5-aea6-4fe0-a92d-11778bd10cf4 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:30:10.235039 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-31aebfe5-aea6-4fe0-a92d-11778bd10cf4 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8f887f5689419e9e31a0ba43f76ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62d19c831574f9b99c993b5e41c645d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:30:10.243735 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-31aebfe5-aea6-4fe0-a92d-11778bd10cf4 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] 10.222.0.46 "GET /compute/v2.1/servers/178b675e-f4d0-442c-aa69-aece6ea3d636" status: 200 len: 1690 microversion: 2.1 time: 0.215981 Aug 04 05:30:10.244703 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 254/512] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:30:10 2022] GET /compute/v2.1/servers/178b675e-f4d0-442c-aa69-aece6ea3d636 => generated 1690 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:30:10.306970 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-cc76008e-7033-4807-80ce-c8fc1d17b14d tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:30:10.307492 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-cc76008e-7033-4807-80ce-c8fc1d17b14d tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] [instance: b45583dc-f18b-4b4a-98e3-ef1bdcf41f80] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:30:10.309407 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG dbcounter [-] [118477] Writing DB stats nova_api:SELECT=28 {{(pid=118477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:30:10.314137 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-cc76008e-7033-4807-80ce-c8fc1d17b14d tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:30:10.314624 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-cc76008e-7033-4807-80ce-c8fc1d17b14d tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:30:10.315377 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-cc76008e-7033-4807-80ce-c8fc1d17b14d tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:30:10.316317 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-cc76008e-7033-4807-80ce-c8fc1d17b14d tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:30:10.340680 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-cc76008e-7033-4807-80ce-c8fc1d17b14d tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] 10.222.0.46 "GET /compute/v2.1/servers/b45583dc-f18b-4b4a-98e3-ef1bdcf41f80/ips" status: 200 len: 151 microversion: 2.1 time: 0.144632 Aug 04 05:30:10.341233 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 259/513] 10.222.0.46 () {58 vars in 1248 bytes} [Thu Aug 4 05:30:10 2022] GET /compute/v2.1/servers/b45583dc-f18b-4b4a-98e3-ef1bdcf41f80/ips => generated 151 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 05:30:11.266298 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-1d6a6d36-edc0-469a-ac74-feb9f5eb9f5b tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:30:11.266925 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-1d6a6d36-edc0-469a-ac74-feb9f5eb9f5b tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] [instance: 178b675e-f4d0-442c-aa69-aece6ea3d636] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:30:11.273551 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-1d6a6d36-edc0-469a-ac74-feb9f5eb9f5b tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:30:11.273995 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-1d6a6d36-edc0-469a-ac74-feb9f5eb9f5b tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:30:11.275010 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-1d6a6d36-edc0-469a-ac74-feb9f5eb9f5b tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:30:11.275299 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-1d6a6d36-edc0-469a-ac74-feb9f5eb9f5b tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:30:11.405338 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-1d6a6d36-edc0-469a-ac74-feb9f5eb9f5b tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8f887f5689419e9e31a0ba43f76ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62d19c831574f9b99c993b5e41c645d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:30:11.413189 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-1d6a6d36-edc0-469a-ac74-feb9f5eb9f5b tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] 10.222.0.46 "GET /compute/v2.1/servers/178b675e-f4d0-442c-aa69-aece6ea3d636" status: 200 len: 1690 microversion: 2.1 time: 0.150838 Aug 04 05:30:11.413761 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 255/514] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:30:11 2022] GET /compute/v2.1/servers/178b675e-f4d0-442c-aa69-aece6ea3d636 => generated 1690 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:30:11.920063 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-55b7f576-08a2-4c7c-a7f3-5d940db70f94 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "06a576c7-7a63-4709-9ba2-e9008b8c96fc"}} {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:30:11.922498 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-55b7f576-08a2-4c7c-a7f3-5d940db70f94 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] [instance: b45583dc-f18b-4b4a-98e3-ef1bdcf41f80] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:30:11.929577 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-55b7f576-08a2-4c7c-a7f3-5d940db70f94 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:30:11.930014 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-55b7f576-08a2-4c7c-a7f3-5d940db70f94 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:30:11.930791 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-55b7f576-08a2-4c7c-a7f3-5d940db70f94 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:30:11.931217 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-55b7f576-08a2-4c7c-a7f3-5d940db70f94 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:30:12.434101 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-e8124504-5c16-41d9-9f6a-b0872f5b6acb tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:30:12.434719 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-e8124504-5c16-41d9-9f6a-b0872f5b6acb tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] [instance: 178b675e-f4d0-442c-aa69-aece6ea3d636] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:30:12.441238 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-e8124504-5c16-41d9-9f6a-b0872f5b6acb tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:30:12.441691 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-e8124504-5c16-41d9-9f6a-b0872f5b6acb tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:30:12.442480 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-e8124504-5c16-41d9-9f6a-b0872f5b6acb tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:30:12.442919 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-e8124504-5c16-41d9-9f6a-b0872f5b6acb tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:30:12.578354 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-e8124504-5c16-41d9-9f6a-b0872f5b6acb tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8f887f5689419e9e31a0ba43f76ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62d19c831574f9b99c993b5e41c645d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:30:12.586816 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-e8124504-5c16-41d9-9f6a-b0872f5b6acb tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] 10.222.0.46 "GET /compute/v2.1/servers/178b675e-f4d0-442c-aa69-aece6ea3d636" status: 200 len: 1690 microversion: 2.1 time: 0.156590 Aug 04 05:30:12.587416 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 256/515] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:30:12 2022] GET /compute/v2.1/servers/178b675e-f4d0-442c-aa69-aece6ea3d636 => generated 1690 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 05:30:13.608234 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-0b950fe6-7cf1-461d-8357-c9b3fcb40886 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:30:13.608904 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-0b950fe6-7cf1-461d-8357-c9b3fcb40886 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] [instance: 178b675e-f4d0-442c-aa69-aece6ea3d636] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:30:13.616487 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-0b950fe6-7cf1-461d-8357-c9b3fcb40886 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:30:13.616935 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-0b950fe6-7cf1-461d-8357-c9b3fcb40886 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:30:13.617701 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-0b950fe6-7cf1-461d-8357-c9b3fcb40886 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:30:13.618137 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-0b950fe6-7cf1-461d-8357-c9b3fcb40886 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:30:13.748644 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-0b950fe6-7cf1-461d-8357-c9b3fcb40886 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8f887f5689419e9e31a0ba43f76ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62d19c831574f9b99c993b5e41c645d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:30:13.756292 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-0b950fe6-7cf1-461d-8357-c9b3fcb40886 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] 10.222.0.46 "GET /compute/v2.1/servers/178b675e-f4d0-442c-aa69-aece6ea3d636" status: 200 len: 1690 microversion: 2.1 time: 0.151956 Aug 04 05:30:13.756860 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 257/516] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:30:13 2022] GET /compute/v2.1/servers/178b675e-f4d0-442c-aa69-aece6ea3d636 => generated 1690 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 05:30:14.881763 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-147898ed-adb1-4320-bdab-a7848ba7a4b1 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:30:14.882447 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-147898ed-adb1-4320-bdab-a7848ba7a4b1 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] [instance: 178b675e-f4d0-442c-aa69-aece6ea3d636] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:30:14.888371 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-147898ed-adb1-4320-bdab-a7848ba7a4b1 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:30:14.888823 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-147898ed-adb1-4320-bdab-a7848ba7a4b1 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:30:14.889791 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-147898ed-adb1-4320-bdab-a7848ba7a4b1 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:30:14.890238 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-147898ed-adb1-4320-bdab-a7848ba7a4b1 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:30:15.033561 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-147898ed-adb1-4320-bdab-a7848ba7a4b1 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8f887f5689419e9e31a0ba43f76ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62d19c831574f9b99c993b5e41c645d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:30:15.042081 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-147898ed-adb1-4320-bdab-a7848ba7a4b1 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] 10.222.0.46 "GET /compute/v2.1/servers/178b675e-f4d0-442c-aa69-aece6ea3d636" status: 200 len: 1690 microversion: 2.1 time: 0.267940 Aug 04 05:30:15.042693 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 258/517] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:30:14 2022] GET /compute/v2.1/servers/178b675e-f4d0-442c-aa69-aece6ea3d636 => generated 1690 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 05:30:16.064737 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-64492e72-ae0d-4201-8468-211e2fe30fe7 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:30:16.065434 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-64492e72-ae0d-4201-8468-211e2fe30fe7 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] [instance: 178b675e-f4d0-442c-aa69-aece6ea3d636] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:30:16.072373 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-64492e72-ae0d-4201-8468-211e2fe30fe7 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:30:16.072918 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-64492e72-ae0d-4201-8468-211e2fe30fe7 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:30:16.073684 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-64492e72-ae0d-4201-8468-211e2fe30fe7 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:30:16.074118 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-64492e72-ae0d-4201-8468-211e2fe30fe7 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:30:16.253608 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-64492e72-ae0d-4201-8468-211e2fe30fe7 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8f887f5689419e9e31a0ba43f76ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62d19c831574f9b99c993b5e41c645d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:30:16.262556 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-64492e72-ae0d-4201-8468-211e2fe30fe7 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] 10.222.0.46 "GET /compute/v2.1/servers/178b675e-f4d0-442c-aa69-aece6ea3d636" status: 200 len: 1690 microversion: 2.1 time: 0.201632 Aug 04 05:30:16.267824 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 259/518] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:30:16 2022] GET /compute/v2.1/servers/178b675e-f4d0-442c-aa69-aece6ea3d636 => generated 1690 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 05:30:16.501446 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-55b7f576-08a2-4c7c-a7f3-5d940db70f94 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] 10.222.0.46 "POST /compute/v2.1/servers/b45583dc-f18b-4b4a-98e3-ef1bdcf41f80/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 4.580642 Aug 04 05:30:16.501446 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 260/519] 10.222.0.46 () {60 vars in 1323 bytes} [Thu Aug 4 05:30:11 2022] POST /compute/v2.1/servers/b45583dc-f18b-4b4a-98e3-ef1bdcf41f80/os-volume_attachments => generated 194 bytes in 4583 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:30:17.164039 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 05:30:17.164507 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: Thu Aug 4 05:30:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 05:30:17.285801 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-94d5d176-2a7f-4783-834b-e46cc1ca6553 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:30:17.287424 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-94d5d176-2a7f-4783-834b-e46cc1ca6553 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] [instance: 178b675e-f4d0-442c-aa69-aece6ea3d636] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:30:17.294197 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-94d5d176-2a7f-4783-834b-e46cc1ca6553 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:30:17.294673 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-94d5d176-2a7f-4783-834b-e46cc1ca6553 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:30:17.295468 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-94d5d176-2a7f-4783-834b-e46cc1ca6553 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:30:17.295899 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-94d5d176-2a7f-4783-834b-e46cc1ca6553 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:30:17.391258 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-94d5d176-2a7f-4783-834b-e46cc1ca6553 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8f887f5689419e9e31a0ba43f76ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62d19c831574f9b99c993b5e41c645d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:30:17.399688 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-94d5d176-2a7f-4783-834b-e46cc1ca6553 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] 10.222.0.46 "GET /compute/v2.1/servers/178b675e-f4d0-442c-aa69-aece6ea3d636" status: 200 len: 1622 microversion: 2.1 time: 0.117946 Aug 04 05:30:17.400270 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 260/520] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:30:17 2022] GET /compute/v2.1/servers/178b675e-f4d0-442c-aa69-aece6ea3d636 => generated 1622 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:30:17.473670 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [req-46bf9df6-14e3-4289-b692-0b7ef3801450 req-709f1159-4992-4340-999a-5e93d2c03523 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "178b675e-f4d0-442c-aa69-aece6ea3d636", "name": "network-vif-deleted", "tag": "ea55da7a-e1dc-47c4-9f10-3c184df3b802"}]} {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:30:17.485947 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [req-46bf9df6-14e3-4289-b692-0b7ef3801450 req-709f1159-4992-4340-999a-5e93d2c03523 service nova] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:30:17.486646 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [req-46bf9df6-14e3-4289-b692-0b7ef3801450 req-709f1159-4992-4340-999a-5e93d2c03523 service nova] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:30:17.498264 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.compute.server_external_events [req-46bf9df6-14e3-4289-b692-0b7ef3801450 req-709f1159-4992-4340-999a-5e93d2c03523 service nova] Creating event network-vif-deleted:ea55da7a-e1dc-47c4-9f10-3c184df3b802 for instance 178b675e-f4d0-442c-aa69-aece6ea3d636 on hv-cinder-85207 Aug 04 05:30:17.503738 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [req-46bf9df6-14e3-4289-b692-0b7ef3801450 req-709f1159-4992-4340-999a-5e93d2c03523 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034281 Aug 04 05:30:17.505045 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 261/521] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Aug 4 05:30:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:30:18.240883 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-af893d55-b091-474b-8e61-d2d31fa5f2c3 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:30:18.241463 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-af893d55-b091-474b-8e61-d2d31fa5f2c3 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] [instance: 8558ff08-5004-4dc4-892d-5b6610ce6bec] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:30:18.247976 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-af893d55-b091-474b-8e61-d2d31fa5f2c3 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:30:18.248420 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-af893d55-b091-474b-8e61-d2d31fa5f2c3 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:30:18.249195 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-af893d55-b091-474b-8e61-d2d31fa5f2c3 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:30:18.249625 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-af893d55-b091-474b-8e61-d2d31fa5f2c3 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:30:18.274952 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.objects.instance [None req-af893d55-b091-474b-8e61-d2d31fa5f2c3 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Lazy-loading 'flavor' on Instance uuid 8558ff08-5004-4dc4-892d-5b6610ce6bec {{(pid=118476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 05:30:18.277421 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG dbcounter [-] [118476] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=118476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:30:18.424260 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-af4e1bc9-80eb-431b-aa26-0e94c2f60c5f tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:30:18.424974 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-af4e1bc9-80eb-431b-aa26-0e94c2f60c5f tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] [instance: 178b675e-f4d0-442c-aa69-aece6ea3d636] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:30:18.431669 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-af4e1bc9-80eb-431b-aa26-0e94c2f60c5f tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:30:18.432189 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-af4e1bc9-80eb-431b-aa26-0e94c2f60c5f tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:30:18.432943 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-af4e1bc9-80eb-431b-aa26-0e94c2f60c5f tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:30:18.433399 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-af4e1bc9-80eb-431b-aa26-0e94c2f60c5f tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:30:18.498223 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-af4e1bc9-80eb-431b-aa26-0e94c2f60c5f tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8f887f5689419e9e31a0ba43f76ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62d19c831574f9b99c993b5e41c645d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:30:18.506756 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-af4e1bc9-80eb-431b-aa26-0e94c2f60c5f tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] 10.222.0.46 "GET /compute/v2.1/servers/178b675e-f4d0-442c-aa69-aece6ea3d636" status: 200 len: 1622 microversion: 2.1 time: 0.086582 Aug 04 05:30:18.511385 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 262/522] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:30:18 2022] GET /compute/v2.1/servers/178b675e-f4d0-442c-aa69-aece6ea3d636 => generated 1622 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 05:30:18.575723 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-af893d55-b091-474b-8e61-d2d31fa5f2c3 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] 10.222.0.46 "POST /compute/v2.1/servers/8558ff08-5004-4dc4-892d-5b6610ce6bec/action" status: 202 len: 0 microversion: 2.1 time: 0.339120 Aug 04 05:30:18.576326 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 261/523] 10.222.0.46 () {60 vars in 1278 bytes} [Thu Aug 4 05:30:18 2022] POST /compute/v2.1/servers/8558ff08-5004-4dc4-892d-5b6610ce6bec/action => generated 0 bytes in 341 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 05:30:18.584903 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-a07b1fe8-33eb-4851-a4b1-59dc0a4149f6 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:30:18.585450 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-a07b1fe8-33eb-4851-a4b1-59dc0a4149f6 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] [instance: 8558ff08-5004-4dc4-892d-5b6610ce6bec] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:30:18.591948 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-a07b1fe8-33eb-4851-a4b1-59dc0a4149f6 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:30:18.592392 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-a07b1fe8-33eb-4851-a4b1-59dc0a4149f6 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:30:18.593156 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-a07b1fe8-33eb-4851-a4b1-59dc0a4149f6 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:30:18.593588 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-a07b1fe8-33eb-4851-a4b1-59dc0a4149f6 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:30:18.747223 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-a07b1fe8-33eb-4851-a4b1-59dc0a4149f6 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965cf2aad5bc4def9fca55aac87cc37e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32569df1dca45cebcdd63d03ff5abae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:30:18.754717 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-a07b1fe8-33eb-4851-a4b1-59dc0a4149f6 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] 10.222.0.46 "GET /compute/v2.1/servers/8558ff08-5004-4dc4-892d-5b6610ce6bec" status: 200 len: 1569 microversion: 2.1 time: 0.173997 Aug 04 05:30:18.755497 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 263/524] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:30:18 2022] GET /compute/v2.1/servers/8558ff08-5004-4dc4-892d-5b6610ce6bec => generated 1569 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:30:19.529990 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-01bcf3e6-1185-4d8f-ae6a-846f5b5541ce tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:30:19.531032 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-01bcf3e6-1185-4d8f-ae6a-846f5b5541ce tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] [instance: 178b675e-f4d0-442c-aa69-aece6ea3d636] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:30:19.537815 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-01bcf3e6-1185-4d8f-ae6a-846f5b5541ce tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:30:19.539022 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-01bcf3e6-1185-4d8f-ae6a-846f5b5541ce tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:30:19.539790 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-01bcf3e6-1185-4d8f-ae6a-846f5b5541ce tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:30:19.540225 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-01bcf3e6-1185-4d8f-ae6a-846f5b5541ce tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:30:19.603689 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-01bcf3e6-1185-4d8f-ae6a-846f5b5541ce tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8f887f5689419e9e31a0ba43f76ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62d19c831574f9b99c993b5e41c645d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:30:19.611109 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-01bcf3e6-1185-4d8f-ae6a-846f5b5541ce tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] 10.222.0.46 "GET /compute/v2.1/servers/178b675e-f4d0-442c-aa69-aece6ea3d636" status: 200 len: 1622 microversion: 2.1 time: 0.085402 Aug 04 05:30:19.611668 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 262/525] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:30:19 2022] GET /compute/v2.1/servers/178b675e-f4d0-442c-aa69-aece6ea3d636 => generated 1622 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:30:19.777650 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-f6f07cbb-7bf3-403e-9cf6-e9bc36f61e92 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:30:19.778518 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-f6f07cbb-7bf3-403e-9cf6-e9bc36f61e92 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] [instance: 8558ff08-5004-4dc4-892d-5b6610ce6bec] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:30:19.785290 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-f6f07cbb-7bf3-403e-9cf6-e9bc36f61e92 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:30:19.785678 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-f6f07cbb-7bf3-403e-9cf6-e9bc36f61e92 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:30:19.786473 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-f6f07cbb-7bf3-403e-9cf6-e9bc36f61e92 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:30:19.786909 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-f6f07cbb-7bf3-403e-9cf6-e9bc36f61e92 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:30:19.925316 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-f6f07cbb-7bf3-403e-9cf6-e9bc36f61e92 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965cf2aad5bc4def9fca55aac87cc37e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32569df1dca45cebcdd63d03ff5abae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:30:19.933949 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-f6f07cbb-7bf3-403e-9cf6-e9bc36f61e92 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] 10.222.0.46 "GET /compute/v2.1/servers/8558ff08-5004-4dc4-892d-5b6610ce6bec" status: 200 len: 1569 microversion: 2.1 time: 0.160186 Aug 04 05:30:19.935009 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 264/526] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:30:19 2022] GET /compute/v2.1/servers/8558ff08-5004-4dc4-892d-5b6610ce6bec => generated 1569 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:30:20.633822 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-7628ac42-6243-4fa7-a7c3-32f59307d032 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:30:20.634510 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-7628ac42-6243-4fa7-a7c3-32f59307d032 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] [instance: 178b675e-f4d0-442c-aa69-aece6ea3d636] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:30:20.640642 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-7628ac42-6243-4fa7-a7c3-32f59307d032 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:30:20.641086 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-7628ac42-6243-4fa7-a7c3-32f59307d032 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:30:20.641853 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-7628ac42-6243-4fa7-a7c3-32f59307d032 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:30:20.642287 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-7628ac42-6243-4fa7-a7c3-32f59307d032 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:30:20.674080 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-7628ac42-6243-4fa7-a7c3-32f59307d032 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:30:20.674562 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-7628ac42-6243-4fa7-a7c3-32f59307d032 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:30:20.675004 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.objects.instance [None req-7628ac42-6243-4fa7-a7c3-32f59307d032 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lazy-loading 'fault' on Instance uuid 178b675e-f4d0-442c-aa69-aece6ea3d636 {{(pid=118476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 05:30:20.723261 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-7628ac42-6243-4fa7-a7c3-32f59307d032 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8f887f5689419e9e31a0ba43f76ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62d19c831574f9b99c993b5e41c645d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:30:20.733095 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-7628ac42-6243-4fa7-a7c3-32f59307d032 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] 10.222.0.46 "GET /compute/v2.1/servers/178b675e-f4d0-442c-aa69-aece6ea3d636" status: 200 len: 1335 microversion: 2.1 time: 0.103735 Aug 04 05:30:20.733675 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 263/527] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:30:20 2022] GET /compute/v2.1/servers/178b675e-f4d0-442c-aa69-aece6ea3d636 => generated 1335 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 05:30:20.958145 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-b41d5c36-ac55-4a29-bb82-56b3be395e21 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:30:20.958783 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-b41d5c36-ac55-4a29-bb82-56b3be395e21 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] [instance: 8558ff08-5004-4dc4-892d-5b6610ce6bec] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:30:20.966982 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-b41d5c36-ac55-4a29-bb82-56b3be395e21 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:30:20.967420 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-b41d5c36-ac55-4a29-bb82-56b3be395e21 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:30:20.968406 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-b41d5c36-ac55-4a29-bb82-56b3be395e21 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:30:20.969056 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-b41d5c36-ac55-4a29-bb82-56b3be395e21 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:30:21.132115 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-b41d5c36-ac55-4a29-bb82-56b3be395e21 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965cf2aad5bc4def9fca55aac87cc37e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32569df1dca45cebcdd63d03ff5abae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:30:21.144104 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-b41d5c36-ac55-4a29-bb82-56b3be395e21 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] 10.222.0.46 "GET /compute/v2.1/servers/8558ff08-5004-4dc4-892d-5b6610ce6bec" status: 200 len: 1569 microversion: 2.1 time: 0.191476 Aug 04 05:30:21.144729 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 265/528] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:30:20 2022] GET /compute/v2.1/servers/8558ff08-5004-4dc4-892d-5b6610ce6bec => generated 1569 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:30:21.755249 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-af0090da-784d-400e-9e2a-fa7f17871c23 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:30:21.755886 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-af0090da-784d-400e-9e2a-fa7f17871c23 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] [instance: 178b675e-f4d0-442c-aa69-aece6ea3d636] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:30:21.763038 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-af0090da-784d-400e-9e2a-fa7f17871c23 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:30:21.763484 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-af0090da-784d-400e-9e2a-fa7f17871c23 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:30:21.764252 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-af0090da-784d-400e-9e2a-fa7f17871c23 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:30:21.764690 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-af0090da-784d-400e-9e2a-fa7f17871c23 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:30:21.778994 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.wsgi [None req-af0090da-784d-400e-9e2a-fa7f17871c23 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] HTTP exception thrown: Instance 178b675e-f4d0-442c-aa69-aece6ea3d636 could not be found. Aug 04 05:30:21.780962 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-af0090da-784d-400e-9e2a-fa7f17871c23 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Request method failure captured: Aug 04 05:30:21.780962 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: request: GET /compute/v2.1/servers/178b675e-f4d0-442c-aa69-aece6ea3d636 HTTP/1.1 Aug 04 05:30:21.780962 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: Accept: application/json Aug 04 05:30:21.780962 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: Accept-Encoding: identity Aug 04 05:30:21.780962 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: Connection: close Aug 04 05:30:21.780962 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: Content-Length: 0 Aug 04 05:30:21.780962 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: Content-Type: application/json Aug 04 05:30:21.780962 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: Host: 10.222.0.46 Aug 04 05:30:21.780962 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: Openstack-System-Scope: None Aug 04 05:30:21.780962 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: User-Agent: python-urllib3/1.26.11 Aug 04 05:30:21.780962 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Auth-Token: gAAAAABi61g53OabLgO4gW69xhev3-hVAHcOcUE9Y2w5YBGtgFfk0SOjtoLwecmlrXgTD_O28rN04Wx-xl4rDlr6cEau3Mp5S6ihh8QrLzUUzoS_WNUMRZYqOqiUmHYH7qSat4VCjMgYwUWTzg9zUzn68Xb9K2m9ofVkhx1oUsZEWZ2JuoREn50 Aug 04 05:30:21.780962 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Domain-Id: None Aug 04 05:30:21.780962 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Domain-Name: None Aug 04 05:30:21.780962 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Identity-Status: Confirmed Aug 04 05:30:21.780962 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Is-Admin-Project: True Aug 04 05:30:21.780962 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Project-Domain-Id: default Aug 04 05:30:21.780962 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Project-Domain-Name: Default Aug 04 05:30:21.780962 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Project-Id: b62d19c831574f9b99c993b5e41c645d Aug 04 05:30:21.780962 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1543928594 Aug 04 05:30:21.780962 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Role: member,reader Aug 04 05:30:21.780962 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Roles: member,reader Aug 04 05:30:21.786788 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/b62d19c831574f9b99c993b5e41c645d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/b62d19c831574f9b99c993b5e41c645d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_b62d19c831574f9b99c993b5e41c645d", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/b62d19c831574f9b99c993b5e41c645d"}]}] Aug 04 05:30:21.786788 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1543928594 Aug 04 05:30:21.786788 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Tenant-Id: b62d19c831574f9b99c993b5e41c645d Aug 04 05:30:21.786788 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1543928594 Aug 04 05:30:21.786788 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-User: tempest-ServerRescueNegativeTestJSON-1543928594-project Aug 04 05:30:21.786788 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-User-Domain-Id: default Aug 04 05:30:21.786788 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-User-Domain-Name: Default Aug 04 05:30:21.786788 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-User-Id: ab8f887f5689419e9e31a0ba43f76ada Aug 04 05:30:21.786788 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1543928594-project Aug 04 05:30:21.786788 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: method: > Aug 04 05:30:21.786788 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: exception: Instance 178b675e-f4d0-442c-aa69-aece6ea3d636 could not be found. Aug 04 05:30:21.786788 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: action_args: {'id': '178b675e-f4d0-442c-aa69-aece6ea3d636'} Aug 04 05:30:21.787675 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 05:30:21.787675 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:30:21.787675 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 05:30:21.787675 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 05:30:21.787675 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 05:30:21.787675 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 05:30:21.787675 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 05:30:21.787675 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 05:30:21.787675 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 05:30:21.787675 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 05:30:21.787675 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 178b675e-f4d0-442c-aa69-aece6ea3d636 could not be found. Aug 04 05:30:21.787675 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Aug 04 05:30:21.787675 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:30:21.787675 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Aug 04 05:30:21.787675 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:30:21.787675 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:30:21.787675 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:30:21.787675 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 05:30:21.787675 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 05:30:21.787675 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 05:30:21.789165 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 05:30:21.789165 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 05:30:21.789165 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 05:30:21.789165 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 05:30:21.789165 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 05:30:21.789165 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 05:30:21.789165 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 05:30:21.789165 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 178b675e-f4d0-442c-aa69-aece6ea3d636 could not be found. Aug 04 05:30:21.789165 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Aug 04 05:30:21.789165 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:30:21.789165 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Aug 04 05:30:21.789165 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:30:21.789165 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:30:21.789165 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:30:21.789165 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 05:30:21.789165 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 05:30:21.789165 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 178b675e-f4d0-442c-aa69-aece6ea3d636 could not be found. Aug 04 05:30:21.789165 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Aug 04 05:30:21.790486 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-af0090da-784d-400e-9e2a-fa7f17871c23 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Returning 404 to user: Instance 178b675e-f4d0-442c-aa69-aece6ea3d636 could not be found. {{(pid=118476) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 05:30:21.790486 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-af0090da-784d-400e-9e2a-fa7f17871c23 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] 10.222.0.46 "GET /compute/v2.1/servers/178b675e-f4d0-442c-aa69-aece6ea3d636" status: 404 len: 111 microversion: 2.1 time: 0.031480 Aug 04 05:30:21.790486 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 264/529] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:30:21 2022] GET /compute/v2.1/servers/178b675e-f4d0-442c-aa69-aece6ea3d636 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 04 05:30:21.791609 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-a1cca97b-3a14-4657-b40a-b7d945bdbdda tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Calling method '.version_select at 0x7f1475564550>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:30:21.864237 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-a1cca97b-3a14-4657-b40a-b7d945bdbdda tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1750445904" status: 202 len: 0 microversion: 2.1 time: 0.076574 Aug 04 05:30:21.865095 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 266/530] 10.222.0.46 () {58 vars in 1221 bytes} [Thu Aug 4 05:30:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1750445904 => generated 0 bytes in 78 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 05:30:22.170866 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-3c3b6689-bf3e-4854-930c-5c8b0d806331 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:30:22.172089 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-3c3b6689-bf3e-4854-930c-5c8b0d806331 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] [instance: 8558ff08-5004-4dc4-892d-5b6610ce6bec] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:30:22.182473 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-3c3b6689-bf3e-4854-930c-5c8b0d806331 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:30:22.183016 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-3c3b6689-bf3e-4854-930c-5c8b0d806331 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:30:22.183963 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-3c3b6689-bf3e-4854-930c-5c8b0d806331 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:30:22.184604 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-3c3b6689-bf3e-4854-930c-5c8b0d806331 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:30:22.421093 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-3c3b6689-bf3e-4854-930c-5c8b0d806331 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965cf2aad5bc4def9fca55aac87cc37e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32569df1dca45cebcdd63d03ff5abae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:30:22.430090 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-3c3b6689-bf3e-4854-930c-5c8b0d806331 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] 10.222.0.46 "GET /compute/v2.1/servers/8558ff08-5004-4dc4-892d-5b6610ce6bec" status: 200 len: 1569 microversion: 2.1 time: 0.266145 Aug 04 05:30:22.430715 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 265/531] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:30:22 2022] GET /compute/v2.1/servers/8558ff08-5004-4dc4-892d-5b6610ce6bec => generated 1569 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 05:30:23.452267 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-799c9602-9bf3-4d30-8d74-653ff7bf8d7e tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:30:23.452822 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-799c9602-9bf3-4d30-8d74-653ff7bf8d7e tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] [instance: 8558ff08-5004-4dc4-892d-5b6610ce6bec] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:30:23.458739 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-799c9602-9bf3-4d30-8d74-653ff7bf8d7e tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:30:23.459206 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-799c9602-9bf3-4d30-8d74-653ff7bf8d7e tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:30:23.460631 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-799c9602-9bf3-4d30-8d74-653ff7bf8d7e tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:30:23.461142 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-799c9602-9bf3-4d30-8d74-653ff7bf8d7e tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:30:23.596535 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-799c9602-9bf3-4d30-8d74-653ff7bf8d7e tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965cf2aad5bc4def9fca55aac87cc37e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32569df1dca45cebcdd63d03ff5abae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:30:23.605027 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-799c9602-9bf3-4d30-8d74-653ff7bf8d7e tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] 10.222.0.46 "GET /compute/v2.1/servers/8558ff08-5004-4dc4-892d-5b6610ce6bec" status: 200 len: 1569 microversion: 2.1 time: 0.157289 Aug 04 05:30:23.605605 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 267/532] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:30:23 2022] GET /compute/v2.1/servers/8558ff08-5004-4dc4-892d-5b6610ce6bec => generated 1569 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:30:24.448146 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-533941cf-15e4-412d-bf75-e7b64ed8749c tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:30:24.448663 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-533941cf-15e4-412d-bf75-e7b64ed8749c tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] [instance: 4edbad4c-dfb3-43c9-992d-f2b2b4744d94] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:30:24.455435 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-533941cf-15e4-412d-bf75-e7b64ed8749c tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:30:24.455826 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-533941cf-15e4-412d-bf75-e7b64ed8749c tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:30:24.456627 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-533941cf-15e4-412d-bf75-e7b64ed8749c tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:30:24.457067 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-533941cf-15e4-412d-bf75-e7b64ed8749c tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:30:24.539436 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.objects.instance [None req-533941cf-15e4-412d-bf75-e7b64ed8749c tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] Lazy-loading 'services' on Instance uuid 4edbad4c-dfb3-43c9-992d-f2b2b4744d94 {{(pid=118476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 05:30:24.626051 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-18d6db5e-ba5b-434d-8b7e-ed67bb6f2357 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:30:24.626700 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-18d6db5e-ba5b-434d-8b7e-ed67bb6f2357 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] [instance: 8558ff08-5004-4dc4-892d-5b6610ce6bec] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:30:24.633492 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-18d6db5e-ba5b-434d-8b7e-ed67bb6f2357 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:30:24.633936 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-18d6db5e-ba5b-434d-8b7e-ed67bb6f2357 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:30:24.634725 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-18d6db5e-ba5b-434d-8b7e-ed67bb6f2357 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:30:24.635154 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-18d6db5e-ba5b-434d-8b7e-ed67bb6f2357 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:30:24.749925 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-533941cf-15e4-412d-bf75-e7b64ed8749c tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] 10.222.0.46 "DELETE /compute/v2.1/servers/4edbad4c-dfb3-43c9-992d-f2b2b4744d94/os-volume_attachments/ccc80c65-f8f3-44aa-83e7-d3925721ae4a" status: 202 len: 0 microversion: 2.1 time: 0.305469 Aug 04 05:30:24.751074 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 266/533] 10.222.0.46 () {58 vars in 1416 bytes} [Thu Aug 4 05:30:24 2022] DELETE /compute/v2.1/servers/4edbad4c-dfb3-43c9-992d-f2b2b4744d94/os-volume_attachments/ccc80c65-f8f3-44aa-83e7-d3925721ae4a => generated 0 bytes in 307 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 05:30:24.777369 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-18d6db5e-ba5b-434d-8b7e-ed67bb6f2357 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965cf2aad5bc4def9fca55aac87cc37e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32569df1dca45cebcdd63d03ff5abae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:30:24.786125 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-18d6db5e-ba5b-434d-8b7e-ed67bb6f2357 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] 10.222.0.46 "GET /compute/v2.1/servers/8558ff08-5004-4dc4-892d-5b6610ce6bec" status: 200 len: 1569 microversion: 2.1 time: 0.163785 Aug 04 05:30:24.786904 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 268/534] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:30:24 2022] GET /compute/v2.1/servers/8558ff08-5004-4dc4-892d-5b6610ce6bec => generated 1569 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 05:30:25.288686 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-5ed99afb-7d5c-4c76-92f5-395010bbda6e tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:30:25.290664 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-5ed99afb-7d5c-4c76-92f5-395010bbda6e tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] [instance: 98f543b7-5432-4a4a-9494-63dac0f733b7] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:30:25.295754 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-5ed99afb-7d5c-4c76-92f5-395010bbda6e tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:30:25.296178 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-5ed99afb-7d5c-4c76-92f5-395010bbda6e tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:30:25.296940 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-5ed99afb-7d5c-4c76-92f5-395010bbda6e tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:30:25.297372 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-5ed99afb-7d5c-4c76-92f5-395010bbda6e tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:30:25.322859 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-5ed99afb-7d5c-4c76-92f5-395010bbda6e tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] [instance: 98f543b7-5432-4a4a-9494-63dac0f733b7] Going to try to terminate instance {{(pid=118476) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 05:30:25.601662 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-5ed99afb-7d5c-4c76-92f5-395010bbda6e tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] 10.222.0.46 "DELETE /compute/v2.1/servers/98f543b7-5432-4a4a-9494-63dac0f733b7" status: 204 len: 0 microversion: 2.1 time: 0.316282 Aug 04 05:30:25.602357 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 267/535] 10.222.0.46 () {58 vars in 1239 bytes} [Thu Aug 4 05:30:25 2022] DELETE /compute/v2.1/servers/98f543b7-5432-4a4a-9494-63dac0f733b7 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 05:30:25.611337 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-f6058efc-1089-4c5e-8026-22cfc075d922 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:30:25.611973 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-f6058efc-1089-4c5e-8026-22cfc075d922 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] [instance: 98f543b7-5432-4a4a-9494-63dac0f733b7] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:30:25.618121 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-f6058efc-1089-4c5e-8026-22cfc075d922 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:30:25.618605 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-f6058efc-1089-4c5e-8026-22cfc075d922 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:30:25.619372 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-f6058efc-1089-4c5e-8026-22cfc075d922 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:30:25.619836 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-f6058efc-1089-4c5e-8026-22cfc075d922 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:30:25.760002 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-f6058efc-1089-4c5e-8026-22cfc075d922 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8f887f5689419e9e31a0ba43f76ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62d19c831574f9b99c993b5e41c645d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:30:25.762430 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG dbcounter [-] [118477] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=118477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:30:25.768656 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-f6058efc-1089-4c5e-8026-22cfc075d922 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] 10.222.0.46 "GET /compute/v2.1/servers/98f543b7-5432-4a4a-9494-63dac0f733b7" status: 200 len: 1509 microversion: 2.1 time: 0.161202 Aug 04 05:30:25.769598 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 269/536] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:30:25 2022] GET /compute/v2.1/servers/98f543b7-5432-4a4a-9494-63dac0f733b7 => generated 1509 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:30:25.808032 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-b92fc343-f38e-46bd-ba43-ad6a8d6f7162 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:30:25.808735 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-b92fc343-f38e-46bd-ba43-ad6a8d6f7162 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] [instance: 8558ff08-5004-4dc4-892d-5b6610ce6bec] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:30:25.814911 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-b92fc343-f38e-46bd-ba43-ad6a8d6f7162 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:30:25.815353 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-b92fc343-f38e-46bd-ba43-ad6a8d6f7162 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:30:25.816219 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-b92fc343-f38e-46bd-ba43-ad6a8d6f7162 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:30:25.816656 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-b92fc343-f38e-46bd-ba43-ad6a8d6f7162 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:30:25.954132 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-b92fc343-f38e-46bd-ba43-ad6a8d6f7162 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965cf2aad5bc4def9fca55aac87cc37e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32569df1dca45cebcdd63d03ff5abae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:30:25.962736 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-b92fc343-f38e-46bd-ba43-ad6a8d6f7162 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] 10.222.0.46 "GET /compute/v2.1/servers/8558ff08-5004-4dc4-892d-5b6610ce6bec" status: 200 len: 1569 microversion: 2.1 time: 0.158862 Aug 04 05:30:25.963319 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 268/537] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:30:25 2022] GET /compute/v2.1/servers/8558ff08-5004-4dc4-892d-5b6610ce6bec => generated 1569 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:30:26.790795 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-97fdec74-2209-4fdd-8372-37da3c1d2f8d tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:30:26.791440 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-97fdec74-2209-4fdd-8372-37da3c1d2f8d tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] [instance: 98f543b7-5432-4a4a-9494-63dac0f733b7] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:30:26.798238 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-97fdec74-2209-4fdd-8372-37da3c1d2f8d tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:30:26.798777 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-97fdec74-2209-4fdd-8372-37da3c1d2f8d tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:30:26.799538 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-97fdec74-2209-4fdd-8372-37da3c1d2f8d tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:30:26.799971 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-97fdec74-2209-4fdd-8372-37da3c1d2f8d tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:30:26.941563 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-97fdec74-2209-4fdd-8372-37da3c1d2f8d tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8f887f5689419e9e31a0ba43f76ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62d19c831574f9b99c993b5e41c645d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:30:26.952262 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-97fdec74-2209-4fdd-8372-37da3c1d2f8d tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] 10.222.0.46 "GET /compute/v2.1/servers/98f543b7-5432-4a4a-9494-63dac0f733b7" status: 200 len: 1509 microversion: 2.1 time: 0.165983 Aug 04 05:30:26.952846 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 270/538] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:30:26 2022] GET /compute/v2.1/servers/98f543b7-5432-4a4a-9494-63dac0f733b7 => generated 1509 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:30:26.983675 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-c1e4dfc7-8a75-4fc5-b836-ee2011309e81 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:30:26.984290 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-c1e4dfc7-8a75-4fc5-b836-ee2011309e81 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] [instance: 8558ff08-5004-4dc4-892d-5b6610ce6bec] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:30:26.991845 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-c1e4dfc7-8a75-4fc5-b836-ee2011309e81 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:30:26.992295 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-c1e4dfc7-8a75-4fc5-b836-ee2011309e81 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:30:26.993067 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-c1e4dfc7-8a75-4fc5-b836-ee2011309e81 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:30:26.993512 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-c1e4dfc7-8a75-4fc5-b836-ee2011309e81 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:30:27.128429 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-c1e4dfc7-8a75-4fc5-b836-ee2011309e81 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965cf2aad5bc4def9fca55aac87cc37e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32569df1dca45cebcdd63d03ff5abae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:30:27.139269 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-c1e4dfc7-8a75-4fc5-b836-ee2011309e81 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] 10.222.0.46 "GET /compute/v2.1/servers/8558ff08-5004-4dc4-892d-5b6610ce6bec" status: 200 len: 1569 microversion: 2.1 time: 0.159318 Aug 04 05:30:27.139889 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 269/539] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:30:26 2022] GET /compute/v2.1/servers/8558ff08-5004-4dc4-892d-5b6610ce6bec => generated 1569 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:30:27.974197 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-11ffca96-54c3-4901-bdc7-386565766c38 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:30:27.974830 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-11ffca96-54c3-4901-bdc7-386565766c38 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] [instance: 98f543b7-5432-4a4a-9494-63dac0f733b7] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:30:27.981374 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-11ffca96-54c3-4901-bdc7-386565766c38 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:30:27.981816 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-11ffca96-54c3-4901-bdc7-386565766c38 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:30:27.982589 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-11ffca96-54c3-4901-bdc7-386565766c38 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:30:27.983039 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-11ffca96-54c3-4901-bdc7-386565766c38 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:30:28.114089 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-11ffca96-54c3-4901-bdc7-386565766c38 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8f887f5689419e9e31a0ba43f76ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62d19c831574f9b99c993b5e41c645d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:30:28.122988 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-11ffca96-54c3-4901-bdc7-386565766c38 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] 10.222.0.46 "GET /compute/v2.1/servers/98f543b7-5432-4a4a-9494-63dac0f733b7" status: 200 len: 1509 microversion: 2.1 time: 0.152587 Aug 04 05:30:28.123567 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 271/540] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:30:27 2022] GET /compute/v2.1/servers/98f543b7-5432-4a4a-9494-63dac0f733b7 => generated 1509 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:30:28.161378 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-db5f28ff-f737-4952-a36e-4f7f09713886 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:30:28.162092 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-db5f28ff-f737-4952-a36e-4f7f09713886 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] [instance: 8558ff08-5004-4dc4-892d-5b6610ce6bec] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:30:28.170195 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-db5f28ff-f737-4952-a36e-4f7f09713886 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:30:28.170346 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-db5f28ff-f737-4952-a36e-4f7f09713886 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:30:28.171034 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-db5f28ff-f737-4952-a36e-4f7f09713886 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:30:28.171565 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-db5f28ff-f737-4952-a36e-4f7f09713886 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:30:28.312634 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-db5f28ff-f737-4952-a36e-4f7f09713886 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965cf2aad5bc4def9fca55aac87cc37e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32569df1dca45cebcdd63d03ff5abae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:30:28.320579 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-db5f28ff-f737-4952-a36e-4f7f09713886 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] 10.222.0.46 "GET /compute/v2.1/servers/8558ff08-5004-4dc4-892d-5b6610ce6bec" status: 200 len: 1569 microversion: 2.1 time: 0.163084 Aug 04 05:30:28.321158 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 270/541] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:30:28 2022] GET /compute/v2.1/servers/8558ff08-5004-4dc4-892d-5b6610ce6bec => generated 1569 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:30:29.144953 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-d0f85da6-e191-48de-95a3-a658bf0c4503 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:30:29.145990 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-d0f85da6-e191-48de-95a3-a658bf0c4503 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] [instance: 98f543b7-5432-4a4a-9494-63dac0f733b7] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:30:29.153313 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-d0f85da6-e191-48de-95a3-a658bf0c4503 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:30:29.153756 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-d0f85da6-e191-48de-95a3-a658bf0c4503 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:30:29.154563 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-d0f85da6-e191-48de-95a3-a658bf0c4503 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:30:29.154998 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-d0f85da6-e191-48de-95a3-a658bf0c4503 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:30:29.269449 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-d0f85da6-e191-48de-95a3-a658bf0c4503 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8f887f5689419e9e31a0ba43f76ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62d19c831574f9b99c993b5e41c645d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:30:29.277930 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-d0f85da6-e191-48de-95a3-a658bf0c4503 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] 10.222.0.46 "GET /compute/v2.1/servers/98f543b7-5432-4a4a-9494-63dac0f733b7" status: 200 len: 1467 microversion: 2.1 time: 0.136924 Aug 04 05:30:29.278767 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 272/542] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:30:29 2022] GET /compute/v2.1/servers/98f543b7-5432-4a4a-9494-63dac0f733b7 => generated 1467 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:30:29.297288 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [req-40fc4632-0756-4bd6-88db-b61f07dd3a78 req-cedfb23e-f6fd-4bd6-8fb7-15a9ccb7171f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98f543b7-5432-4a4a-9494-63dac0f733b7", "name": "network-vif-deleted", "tag": "f35fb18f-8eba-4e19-9262-240ca4bdb983"}]} {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:30:29.311092 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [req-40fc4632-0756-4bd6-88db-b61f07dd3a78 req-cedfb23e-f6fd-4bd6-8fb7-15a9ccb7171f service nova] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:30:29.311544 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [req-40fc4632-0756-4bd6-88db-b61f07dd3a78 req-cedfb23e-f6fd-4bd6-8fb7-15a9ccb7171f service nova] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:30:29.323525 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.compute.server_external_events [req-40fc4632-0756-4bd6-88db-b61f07dd3a78 req-cedfb23e-f6fd-4bd6-8fb7-15a9ccb7171f service nova] Creating event network-vif-deleted:f35fb18f-8eba-4e19-9262-240ca4bdb983 for instance 98f543b7-5432-4a4a-9494-63dac0f733b7 on hv-cinder-85207 Aug 04 05:30:29.330045 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [req-40fc4632-0756-4bd6-88db-b61f07dd3a78 req-cedfb23e-f6fd-4bd6-8fb7-15a9ccb7171f service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050055 Aug 04 05:30:29.330882 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 271/543] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Aug 4 05:30:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:30:29.341967 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-0f15d562-ec91-4acb-86fe-d2677d77f265 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:30:29.342599 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-0f15d562-ec91-4acb-86fe-d2677d77f265 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] [instance: 8558ff08-5004-4dc4-892d-5b6610ce6bec] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:30:29.348721 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-0f15d562-ec91-4acb-86fe-d2677d77f265 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:30:29.349164 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-0f15d562-ec91-4acb-86fe-d2677d77f265 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:30:29.349933 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-0f15d562-ec91-4acb-86fe-d2677d77f265 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:30:29.350619 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-0f15d562-ec91-4acb-86fe-d2677d77f265 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:30:29.489594 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-0f15d562-ec91-4acb-86fe-d2677d77f265 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965cf2aad5bc4def9fca55aac87cc37e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32569df1dca45cebcdd63d03ff5abae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:30:29.498272 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-0f15d562-ec91-4acb-86fe-d2677d77f265 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] 10.222.0.46 "GET /compute/v2.1/servers/8558ff08-5004-4dc4-892d-5b6610ce6bec" status: 200 len: 1569 microversion: 2.1 time: 0.160413 Aug 04 05:30:29.498859 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 273/544] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:30:29 2022] GET /compute/v2.1/servers/8558ff08-5004-4dc4-892d-5b6610ce6bec => generated 1569 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:30:30.302108 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-3377f211-c2bf-4d79-9019-848e79722e38 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:30:30.302824 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-3377f211-c2bf-4d79-9019-848e79722e38 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] [instance: 98f543b7-5432-4a4a-9494-63dac0f733b7] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:30:30.309421 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-3377f211-c2bf-4d79-9019-848e79722e38 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:30:30.309863 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-3377f211-c2bf-4d79-9019-848e79722e38 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:30:30.310662 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-3377f211-c2bf-4d79-9019-848e79722e38 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:30:30.311097 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-3377f211-c2bf-4d79-9019-848e79722e38 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:30:30.343267 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-3377f211-c2bf-4d79-9019-848e79722e38 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:30:30.343710 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-3377f211-c2bf-4d79-9019-848e79722e38 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:30:30.344153 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.objects.instance [None req-3377f211-c2bf-4d79-9019-848e79722e38 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lazy-loading 'fault' on Instance uuid 98f543b7-5432-4a4a-9494-63dac0f733b7 {{(pid=118476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 05:30:30.401634 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-3377f211-c2bf-4d79-9019-848e79722e38 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8f887f5689419e9e31a0ba43f76ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62d19c831574f9b99c993b5e41c645d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:30:30.410711 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-3377f211-c2bf-4d79-9019-848e79722e38 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] 10.222.0.46 "GET /compute/v2.1/servers/98f543b7-5432-4a4a-9494-63dac0f733b7" status: 200 len: 1312 microversion: 2.1 time: 0.112540 Aug 04 05:30:30.417596 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 272/545] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:30:30 2022] GET /compute/v2.1/servers/98f543b7-5432-4a4a-9494-63dac0f733b7 => generated 1312 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:30:30.469826 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-919a2926-9d97-4d99-a2bc-172dbc721f87 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "06a576c7-7a63-4709-9ba2-e9008b8c96fc"}} {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:30:30.472292 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-919a2926-9d97-4d99-a2bc-172dbc721f87 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] [instance: b45583dc-f18b-4b4a-98e3-ef1bdcf41f80] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:30:30.480326 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-919a2926-9d97-4d99-a2bc-172dbc721f87 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:30:30.480430 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-919a2926-9d97-4d99-a2bc-172dbc721f87 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:30:30.481149 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-919a2926-9d97-4d99-a2bc-172dbc721f87 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:30:30.481579 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-919a2926-9d97-4d99-a2bc-172dbc721f87 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:30:30.520936 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-dade5a97-5200-4646-9c41-c52c57248857 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:30:30.521577 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-dade5a97-5200-4646-9c41-c52c57248857 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] [instance: 8558ff08-5004-4dc4-892d-5b6610ce6bec] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:30:30.528708 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-dade5a97-5200-4646-9c41-c52c57248857 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:30:30.532360 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-dade5a97-5200-4646-9c41-c52c57248857 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:30:30.532360 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-dade5a97-5200-4646-9c41-c52c57248857 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:30:30.532360 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-dade5a97-5200-4646-9c41-c52c57248857 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:30:30.596199 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.wsgi [None req-919a2926-9d97-4d99-a2bc-172dbc721f87 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] HTTP exception thrown: Invalid volume: volume 06a576c7-7a63-4709-9ba2-e9008b8c96fc is already attached to instances: b45583dc-f18b-4b4a-98e3-ef1bdcf41f80 Aug 04 05:30:30.598319 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-919a2926-9d97-4d99-a2bc-172dbc721f87 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Request method failure captured: Aug 04 05:30:30.598319 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: request: POST /compute/v2.1/servers/b45583dc-f18b-4b4a-98e3-ef1bdcf41f80/os-volume_attachments HTTP/1.1 Aug 04 05:30:30.598319 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: Accept: application/json Aug 04 05:30:30.598319 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: Accept-Encoding: identity Aug 04 05:30:30.598319 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: Connection: close Aug 04 05:30:30.598319 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: Content-Length: 74 Aug 04 05:30:30.598319 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: Content-Type: application/json Aug 04 05:30:30.598319 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: Host: 10.222.0.46 Aug 04 05:30:30.598319 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: Openstack-System-Scope: None Aug 04 05:30:30.598319 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: User-Agent: python-urllib3/1.26.11 Aug 04 05:30:30.598319 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Auth-Token: gAAAAABi61g0x_8sFigG1jfXTOdqOMY1_3lK7UxaN3VmL5lqQXtIkCz4pWJYdYey2zGuiTigaV5gr0UWhaKZvxst4Kz-KOaAO64aM30ubWqVQfLIrJqf-RP6LF-c0ZabM-LUcJmxEmCuhHsUTEzNbVJn1WT0ja1hpuQC9pVY6l0Uzp1TYNzYyh0 Aug 04 05:30:30.598319 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Domain-Id: None Aug 04 05:30:30.598319 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Domain-Name: None Aug 04 05:30:30.598319 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Identity-Status: Confirmed Aug 04 05:30:30.598319 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Is-Admin-Project: True Aug 04 05:30:30.598319 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Project-Domain-Id: default Aug 04 05:30:30.598319 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Project-Domain-Name: Default Aug 04 05:30:30.598319 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Project-Id: faead990837d43de8ec54bfaf24361de Aug 04 05:30:30.598319 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Project-Name: tempest-AttachVolumeNegativeTest-710656709 Aug 04 05:30:30.598319 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Role: member,reader Aug 04 05:30:30.598319 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Roles: member,reader Aug 04 05:30:30.599806 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/faead990837d43de8ec54bfaf24361de"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/faead990837d43de8ec54bfaf24361de"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_faead990837d43de8ec54bfaf24361de", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/faead990837d43de8ec54bfaf24361de"}]}] Aug 04 05:30:30.599806 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Tenant: tempest-AttachVolumeNegativeTest-710656709 Aug 04 05:30:30.599806 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Tenant-Id: faead990837d43de8ec54bfaf24361de Aug 04 05:30:30.599806 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-710656709 Aug 04 05:30:30.599806 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-User: tempest-AttachVolumeNegativeTest-710656709-project Aug 04 05:30:30.599806 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-User-Domain-Id: default Aug 04 05:30:30.599806 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-User-Domain-Name: Default Aug 04 05:30:30.599806 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-User-Id: 9cb49b631c234f9a9fd47049b9b2e097 Aug 04 05:30:30.599806 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-User-Name: tempest-AttachVolumeNegativeTest-710656709-project Aug 04 05:30:30.599806 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: Aug 04 05:30:30.599806 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: {"volumeAttachment": {"volumeId": "06a576c7-7a63-4709-9ba2-e9008b8c96fc"}} Aug 04 05:30:30.599806 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: method: > Aug 04 05:30:30.600529 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: exception: Invalid volume: volume 06a576c7-7a63-4709-9ba2-e9008b8c96fc is already attached to instances: b45583dc-f18b-4b4a-98e3-ef1bdcf41f80 Aug 04 05:30:30.600529 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: action_args: {'server_id': 'b45583dc-f18b-4b4a-98e3-ef1bdcf41f80', 'body': {'volumeAttachment': {'volumeId': '06a576c7-7a63-4709-9ba2-e9008b8c96fc'}}} Aug 04 05:30:30.600529 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 05:30:30.600529 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:30:30.600529 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 04 05:30:30.600529 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 04 05:30:30.600529 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 04 05:30:30.600529 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 04 05:30:30.600529 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 04 05:30:30.600529 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 04 05:30:30.600529 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5066, in attach_volume Aug 04 05:30:30.600529 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 04 05:30:30.600529 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4906, in _check_volume_already_attached Aug 04 05:30:30.600529 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 04 05:30:30.600529 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 06a576c7-7a63-4709-9ba2-e9008b8c96fc is already attached to instances: b45583dc-f18b-4b4a-98e3-ef1bdcf41f80 Aug 04 05:30:30.600529 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Aug 04 05:30:30.600529 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:30:30.600529 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Aug 04 05:30:30.600529 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:30:30.601775 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:30:30.601775 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:30:30.601775 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 05:30:30.601775 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 05:30:30.601775 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 05:30:30.601775 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 05:30:30.601775 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 05:30:30.601775 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 05:30:30.601775 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 05:30:30.601775 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 05:30:30.601775 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 05:30:30.601775 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 05:30:30.601775 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 04 05:30:30.601775 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 04 05:30:30.601775 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 06a576c7-7a63-4709-9ba2-e9008b8c96fc is already attached to instances: b45583dc-f18b-4b4a-98e3-ef1bdcf41f80 Aug 04 05:30:30.601775 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Aug 04 05:30:30.601775 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:30:30.601775 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Aug 04 05:30:30.601775 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:30:30.601775 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:30:30.603142 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:30:30.603142 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 05:30:30.603142 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 05:30:30.603142 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 06a576c7-7a63-4709-9ba2-e9008b8c96fc is already attached to instances: b45583dc-f18b-4b4a-98e3-ef1bdcf41f80 Aug 04 05:30:30.603142 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Aug 04 05:30:30.603142 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-919a2926-9d97-4d99-a2bc-172dbc721f87 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Returning 400 to user: Invalid volume: volume 06a576c7-7a63-4709-9ba2-e9008b8c96fc is already attached to instances: b45583dc-f18b-4b4a-98e3-ef1bdcf41f80 {{(pid=118477) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 05:30:30.605649 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-919a2926-9d97-4d99-a2bc-172dbc721f87 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] 10.222.0.46 "POST /compute/v2.1/servers/b45583dc-f18b-4b4a-98e3-ef1bdcf41f80/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.134024 Aug 04 05:30:30.607329 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 274/546] 10.222.0.46 () {60 vars in 1323 bytes} [Thu Aug 4 05:30:30 2022] POST /compute/v2.1/servers/b45583dc-f18b-4b4a-98e3-ef1bdcf41f80/os-volume_attachments => generated 174 bytes in 142 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 04 05:30:30.682836 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-fe02e2f5-241b-4a3f-a582-d9ae623190d9 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:30:30.683331 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-fe02e2f5-241b-4a3f-a582-d9ae623190d9 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] [instance: b45583dc-f18b-4b4a-98e3-ef1bdcf41f80] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:30:30.689449 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-fe02e2f5-241b-4a3f-a582-d9ae623190d9 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:30:30.689899 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-fe02e2f5-241b-4a3f-a582-d9ae623190d9 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:30:30.691369 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-fe02e2f5-241b-4a3f-a582-d9ae623190d9 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:30:30.691805 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-fe02e2f5-241b-4a3f-a582-d9ae623190d9 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:30:30.806274 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.objects.instance [None req-fe02e2f5-241b-4a3f-a582-d9ae623190d9 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lazy-loading 'services' on Instance uuid b45583dc-f18b-4b4a-98e3-ef1bdcf41f80 {{(pid=118477) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 05:30:30.814860 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-dade5a97-5200-4646-9c41-c52c57248857 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965cf2aad5bc4def9fca55aac87cc37e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32569df1dca45cebcdd63d03ff5abae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:30:30.824856 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-dade5a97-5200-4646-9c41-c52c57248857 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] 10.222.0.46 "GET /compute/v2.1/servers/8558ff08-5004-4dc4-892d-5b6610ce6bec" status: 200 len: 1569 microversion: 2.1 time: 0.307899 Aug 04 05:30:30.825625 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 273/547] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:30:30 2022] GET /compute/v2.1/servers/8558ff08-5004-4dc4-892d-5b6610ce6bec => generated 1569 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 05:30:31.035126 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-fe02e2f5-241b-4a3f-a582-d9ae623190d9 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] 10.222.0.46 "DELETE /compute/v2.1/servers/b45583dc-f18b-4b4a-98e3-ef1bdcf41f80/os-volume_attachments/06a576c7-7a63-4709-9ba2-e9008b8c96fc" status: 202 len: 0 microversion: 2.1 time: 0.356086 Aug 04 05:30:31.035882 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 275/548] 10.222.0.46 () {58 vars in 1416 bytes} [Thu Aug 4 05:30:30 2022] DELETE /compute/v2.1/servers/b45583dc-f18b-4b4a-98e3-ef1bdcf41f80/os-volume_attachments/06a576c7-7a63-4709-9ba2-e9008b8c96fc => generated 0 bytes in 358 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 04 05:30:31.044872 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-397679a8-379f-49be-93c3-eeba3e18b4fa tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:30:31.047424 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-397679a8-379f-49be-93c3-eeba3e18b4fa tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] [instance: b45583dc-f18b-4b4a-98e3-ef1bdcf41f80] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:30:31.055183 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-397679a8-379f-49be-93c3-eeba3e18b4fa tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:30:31.055941 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-397679a8-379f-49be-93c3-eeba3e18b4fa tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:30:31.056833 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-397679a8-379f-49be-93c3-eeba3e18b4fa tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:30:31.057340 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-397679a8-379f-49be-93c3-eeba3e18b4fa tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:30:31.086163 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG dbcounter [-] [118476] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=118476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:30:31.092820 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-397679a8-379f-49be-93c3-eeba3e18b4fa tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] 10.222.0.46 "GET /compute/v2.1/servers/b45583dc-f18b-4b4a-98e3-ef1bdcf41f80/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052118 Aug 04 05:30:31.093720 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 274/549] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Aug 4 05:30:31 2022] GET /compute/v2.1/servers/b45583dc-f18b-4b4a-98e3-ef1bdcf41f80/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:30:31.208681 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-92db69ca-6e0f-436f-b5a2-051efcb2396c tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:30:31.209276 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-92db69ca-6e0f-436f-b5a2-051efcb2396c tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] [instance: 4edbad4c-dfb3-43c9-992d-f2b2b4744d94] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:30:31.216265 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-92db69ca-6e0f-436f-b5a2-051efcb2396c tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:30:31.216711 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-92db69ca-6e0f-436f-b5a2-051efcb2396c tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:30:31.218135 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-92db69ca-6e0f-436f-b5a2-051efcb2396c tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:30:31.218135 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-92db69ca-6e0f-436f-b5a2-051efcb2396c tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:30:31.248919 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-92db69ca-6e0f-436f-b5a2-051efcb2396c tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] [instance: 4edbad4c-dfb3-43c9-992d-f2b2b4744d94] Going to try to terminate instance {{(pid=118477) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 05:30:31.433314 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-86a24348-4271-41d1-9980-2f7b5e9fb379 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:30:31.433922 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-86a24348-4271-41d1-9980-2f7b5e9fb379 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] [instance: 98f543b7-5432-4a4a-9494-63dac0f733b7] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:30:31.441124 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-86a24348-4271-41d1-9980-2f7b5e9fb379 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:30:31.441811 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-86a24348-4271-41d1-9980-2f7b5e9fb379 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:30:31.442543 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-86a24348-4271-41d1-9980-2f7b5e9fb379 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:30:31.442982 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-86a24348-4271-41d1-9980-2f7b5e9fb379 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:30:31.457299 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.wsgi [None req-86a24348-4271-41d1-9980-2f7b5e9fb379 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] HTTP exception thrown: Instance 98f543b7-5432-4a4a-9494-63dac0f733b7 could not be found. Aug 04 05:30:31.458997 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-86a24348-4271-41d1-9980-2f7b5e9fb379 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Request method failure captured: Aug 04 05:30:31.458997 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: request: GET /compute/v2.1/servers/98f543b7-5432-4a4a-9494-63dac0f733b7 HTTP/1.1 Aug 04 05:30:31.458997 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: Accept: application/json Aug 04 05:30:31.458997 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: Accept-Encoding: identity Aug 04 05:30:31.458997 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: Connection: close Aug 04 05:30:31.458997 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: Content-Length: 0 Aug 04 05:30:31.458997 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: Content-Type: application/json Aug 04 05:30:31.458997 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: Host: 10.222.0.46 Aug 04 05:30:31.458997 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: Openstack-System-Scope: None Aug 04 05:30:31.458997 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: User-Agent: python-urllib3/1.26.11 Aug 04 05:30:31.458997 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Auth-Token: gAAAAABi61g53OabLgO4gW69xhev3-hVAHcOcUE9Y2w5YBGtgFfk0SOjtoLwecmlrXgTD_O28rN04Wx-xl4rDlr6cEau3Mp5S6ihh8QrLzUUzoS_WNUMRZYqOqiUmHYH7qSat4VCjMgYwUWTzg9zUzn68Xb9K2m9ofVkhx1oUsZEWZ2JuoREn50 Aug 04 05:30:31.458997 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Domain-Id: None Aug 04 05:30:31.458997 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Domain-Name: None Aug 04 05:30:31.458997 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Identity-Status: Confirmed Aug 04 05:30:31.458997 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Is-Admin-Project: True Aug 04 05:30:31.458997 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Project-Domain-Id: default Aug 04 05:30:31.458997 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Project-Domain-Name: Default Aug 04 05:30:31.458997 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Project-Id: b62d19c831574f9b99c993b5e41c645d Aug 04 05:30:31.458997 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1543928594 Aug 04 05:30:31.458997 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Role: member,reader Aug 04 05:30:31.458997 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Roles: member,reader Aug 04 05:30:31.460419 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/b62d19c831574f9b99c993b5e41c645d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/b62d19c831574f9b99c993b5e41c645d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_b62d19c831574f9b99c993b5e41c645d", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/b62d19c831574f9b99c993b5e41c645d"}]}] Aug 04 05:30:31.460419 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1543928594 Aug 04 05:30:31.460419 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Tenant-Id: b62d19c831574f9b99c993b5e41c645d Aug 04 05:30:31.460419 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1543928594 Aug 04 05:30:31.460419 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-User: tempest-ServerRescueNegativeTestJSON-1543928594-project Aug 04 05:30:31.460419 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-User-Domain-Id: default Aug 04 05:30:31.460419 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-User-Domain-Name: Default Aug 04 05:30:31.460419 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-User-Id: ab8f887f5689419e9e31a0ba43f76ada Aug 04 05:30:31.460419 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1543928594-project Aug 04 05:30:31.460419 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: method: > Aug 04 05:30:31.460419 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: exception: Instance 98f543b7-5432-4a4a-9494-63dac0f733b7 could not be found. Aug 04 05:30:31.460419 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: action_args: {'id': '98f543b7-5432-4a4a-9494-63dac0f733b7'} Aug 04 05:30:31.461131 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 05:30:31.461131 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:30:31.461131 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 05:30:31.461131 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 05:30:31.461131 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 05:30:31.461131 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 05:30:31.461131 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 05:30:31.461131 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 05:30:31.461131 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 05:30:31.461131 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 05:30:31.461131 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 98f543b7-5432-4a4a-9494-63dac0f733b7 could not be found. Aug 04 05:30:31.461131 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Aug 04 05:30:31.461131 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:30:31.461131 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Aug 04 05:30:31.461131 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:30:31.461131 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:30:31.461131 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:30:31.461131 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 05:30:31.461131 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 05:30:31.461131 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 05:30:31.463066 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 05:30:31.463066 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 05:30:31.463066 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 05:30:31.463066 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 05:30:31.463066 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 05:30:31.463066 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 05:30:31.463066 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 05:30:31.463066 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 98f543b7-5432-4a4a-9494-63dac0f733b7 could not be found. Aug 04 05:30:31.463066 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Aug 04 05:30:31.463066 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:30:31.463066 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Aug 04 05:30:31.463066 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:30:31.463066 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:30:31.463066 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:30:31.463066 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 05:30:31.463066 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 05:30:31.463066 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 98f543b7-5432-4a4a-9494-63dac0f733b7 could not be found. Aug 04 05:30:31.463066 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Aug 04 05:30:31.465011 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-86a24348-4271-41d1-9980-2f7b5e9fb379 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Returning 404 to user: Instance 98f543b7-5432-4a4a-9494-63dac0f733b7 could not be found. {{(pid=118476) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 05:30:31.465011 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-86a24348-4271-41d1-9980-2f7b5e9fb379 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] 10.222.0.46 "GET /compute/v2.1/servers/98f543b7-5432-4a4a-9494-63dac0f733b7" status: 404 len: 111 microversion: 2.1 time: 0.032021 Aug 04 05:30:31.465011 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 275/550] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:30:31 2022] GET /compute/v2.1/servers/98f543b7-5432-4a4a-9494-63dac0f733b7 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 04 05:30:31.469851 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-a6638225-9ae6-4207-a77d-248a9823b895 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:30:31.470370 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-a6638225-9ae6-4207-a77d-248a9823b895 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] [instance: b1a612df-55d1-4106-951d-7f0ea95cfe83] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:30:31.478613 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-a6638225-9ae6-4207-a77d-248a9823b895 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:30:31.479197 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-a6638225-9ae6-4207-a77d-248a9823b895 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:30:31.480160 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-a6638225-9ae6-4207-a77d-248a9823b895 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:30:31.480691 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-a6638225-9ae6-4207-a77d-248a9823b895 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:30:31.510224 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-a6638225-9ae6-4207-a77d-248a9823b895 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] [instance: b1a612df-55d1-4106-951d-7f0ea95cfe83] Going to try to terminate instance {{(pid=118476) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 05:30:31.571793 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-92db69ca-6e0f-436f-b5a2-051efcb2396c tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] 10.222.0.46 "DELETE /compute/v2.1/servers/4edbad4c-dfb3-43c9-992d-f2b2b4744d94" status: 204 len: 0 microversion: 2.1 time: 0.373074 Aug 04 05:30:31.572412 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 276/551] 10.222.0.46 () {58 vars in 1239 bytes} [Thu Aug 4 05:30:31 2022] DELETE /compute/v2.1/servers/4edbad4c-dfb3-43c9-992d-f2b2b4744d94 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 05:30:31.581051 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-5eb2a8e7-0666-4761-8a59-6ed5ee607254 tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:30:31.581756 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-5eb2a8e7-0666-4761-8a59-6ed5ee607254 tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] [instance: 4edbad4c-dfb3-43c9-992d-f2b2b4744d94] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:30:31.588908 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-5eb2a8e7-0666-4761-8a59-6ed5ee607254 tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:30:31.589365 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-5eb2a8e7-0666-4761-8a59-6ed5ee607254 tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:30:31.590129 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-5eb2a8e7-0666-4761-8a59-6ed5ee607254 tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:30:31.590644 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-5eb2a8e7-0666-4761-8a59-6ed5ee607254 tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:30:31.808687 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-5eb2a8e7-0666-4761-8a59-6ed5ee607254 tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5af2248451d3483d9742887d614a5077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520d3d5e2e804be1bd5dc9bfc50c5de8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:30:31.812056 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-a6638225-9ae6-4207-a77d-248a9823b895 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] 10.222.0.46 "DELETE /compute/v2.1/servers/b1a612df-55d1-4106-951d-7f0ea95cfe83" status: 204 len: 0 microversion: 2.1 time: 0.345766 Aug 04 05:30:31.812656 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 276/552] 10.222.0.46 () {58 vars in 1239 bytes} [Thu Aug 4 05:30:31 2022] DELETE /compute/v2.1/servers/b1a612df-55d1-4106-951d-7f0ea95cfe83 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 05:30:31.816813 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-5eb2a8e7-0666-4761-8a59-6ed5ee607254 tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] 10.222.0.46 "GET /compute/v2.1/servers/4edbad4c-dfb3-43c9-992d-f2b2b4744d94" status: 200 len: 1513 microversion: 2.1 time: 0.240021 Aug 04 05:30:31.831735 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 277/553] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:30:31 2022] GET /compute/v2.1/servers/4edbad4c-dfb3-43c9-992d-f2b2b4744d94 => generated 1513 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 05:30:31.831888 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-05ec709f-e46f-4b29-b1c8-63db6a289eb6 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:30:31.831888 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-05ec709f-e46f-4b29-b1c8-63db6a289eb6 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] [instance: b1a612df-55d1-4106-951d-7f0ea95cfe83] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:30:31.831888 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-05ec709f-e46f-4b29-b1c8-63db6a289eb6 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:30:31.831888 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-05ec709f-e46f-4b29-b1c8-63db6a289eb6 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:30:31.832266 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-05ec709f-e46f-4b29-b1c8-63db6a289eb6 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:30:31.832266 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-05ec709f-e46f-4b29-b1c8-63db6a289eb6 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:30:31.849122 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-928f5d48-f261-48d4-a741-6967bee897c3 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:30:31.849704 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-928f5d48-f261-48d4-a741-6967bee897c3 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] [instance: 8558ff08-5004-4dc4-892d-5b6610ce6bec] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:30:31.857236 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-928f5d48-f261-48d4-a741-6967bee897c3 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:30:31.857676 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-928f5d48-f261-48d4-a741-6967bee897c3 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:30:31.858490 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-928f5d48-f261-48d4-a741-6967bee897c3 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:30:31.858958 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-928f5d48-f261-48d4-a741-6967bee897c3 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:30:32.057905 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-05ec709f-e46f-4b29-b1c8-63db6a289eb6 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8f887f5689419e9e31a0ba43f76ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62d19c831574f9b99c993b5e41c645d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:30:32.065723 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-05ec709f-e46f-4b29-b1c8-63db6a289eb6 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] 10.222.0.46 "GET /compute/v2.1/servers/b1a612df-55d1-4106-951d-7f0ea95cfe83" status: 200 len: 1522 microversion: 2.1 time: 0.248453 Aug 04 05:30:32.066275 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 277/554] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:30:31 2022] GET /compute/v2.1/servers/b1a612df-55d1-4106-951d-7f0ea95cfe83 => generated 1522 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:30:32.071475 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-928f5d48-f261-48d4-a741-6967bee897c3 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965cf2aad5bc4def9fca55aac87cc37e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32569df1dca45cebcdd63d03ff5abae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:30:32.079112 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-928f5d48-f261-48d4-a741-6967bee897c3 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] 10.222.0.46 "GET /compute/v2.1/servers/8558ff08-5004-4dc4-892d-5b6610ce6bec" status: 200 len: 1569 microversion: 2.1 time: 0.234018 Aug 04 05:30:32.079681 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 278/555] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:30:31 2022] GET /compute/v2.1/servers/8558ff08-5004-4dc4-892d-5b6610ce6bec => generated 1569 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 05:30:32.105180 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-667756ba-8706-4fb1-b954-c8fe70778ad6 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:30:32.107501 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-667756ba-8706-4fb1-b954-c8fe70778ad6 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] [instance: b45583dc-f18b-4b4a-98e3-ef1bdcf41f80] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:30:32.113623 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-667756ba-8706-4fb1-b954-c8fe70778ad6 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:30:32.114066 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-667756ba-8706-4fb1-b954-c8fe70778ad6 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:30:32.114872 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-667756ba-8706-4fb1-b954-c8fe70778ad6 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:30:32.115305 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-667756ba-8706-4fb1-b954-c8fe70778ad6 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:30:32.149186 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-667756ba-8706-4fb1-b954-c8fe70778ad6 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] 10.222.0.46 "GET /compute/v2.1/servers/b45583dc-f18b-4b4a-98e3-ef1bdcf41f80/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047851 Aug 04 05:30:32.149775 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 278/556] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Aug 4 05:30:32 2022] GET /compute/v2.1/servers/b45583dc-f18b-4b4a-98e3-ef1bdcf41f80/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:30:32.845445 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-0029f7e4-60bd-4046-bc15-4ee67e0756d8 tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:30:32.846085 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-0029f7e4-60bd-4046-bc15-4ee67e0756d8 tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] [instance: 4edbad4c-dfb3-43c9-992d-f2b2b4744d94] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:30:32.853476 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-0029f7e4-60bd-4046-bc15-4ee67e0756d8 tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:30:32.853915 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-0029f7e4-60bd-4046-bc15-4ee67e0756d8 tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:30:32.854723 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-0029f7e4-60bd-4046-bc15-4ee67e0756d8 tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:30:32.855152 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-0029f7e4-60bd-4046-bc15-4ee67e0756d8 tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:30:32.994681 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-0029f7e4-60bd-4046-bc15-4ee67e0756d8 tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5af2248451d3483d9742887d614a5077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520d3d5e2e804be1bd5dc9bfc50c5de8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:30:33.002254 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-0029f7e4-60bd-4046-bc15-4ee67e0756d8 tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] 10.222.0.46 "GET /compute/v2.1/servers/4edbad4c-dfb3-43c9-992d-f2b2b4744d94" status: 200 len: 1513 microversion: 2.1 time: 0.160775 Aug 04 05:30:33.002860 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 279/557] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:30:32 2022] GET /compute/v2.1/servers/4edbad4c-dfb3-43c9-992d-f2b2b4744d94 => generated 1513 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:30:33.088826 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-c800e14b-66d5-476b-b221-9f6a91de7bbf tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:30:33.089691 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-c800e14b-66d5-476b-b221-9f6a91de7bbf tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] [instance: b1a612df-55d1-4106-951d-7f0ea95cfe83] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:30:33.096045 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-c800e14b-66d5-476b-b221-9f6a91de7bbf tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:30:33.096403 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-c800e14b-66d5-476b-b221-9f6a91de7bbf tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:30:33.097165 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-c800e14b-66d5-476b-b221-9f6a91de7bbf tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:30:33.097590 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-c800e14b-66d5-476b-b221-9f6a91de7bbf tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:30:33.101764 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-c4c2f68d-528f-408a-a1ac-2520ad8f94b3 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:30:33.102423 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-c4c2f68d-528f-408a-a1ac-2520ad8f94b3 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] [instance: 8558ff08-5004-4dc4-892d-5b6610ce6bec] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:30:33.108451 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-c4c2f68d-528f-408a-a1ac-2520ad8f94b3 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:30:33.108911 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-c4c2f68d-528f-408a-a1ac-2520ad8f94b3 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:30:33.109683 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-c4c2f68d-528f-408a-a1ac-2520ad8f94b3 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:30:33.110108 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-c4c2f68d-528f-408a-a1ac-2520ad8f94b3 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:30:33.358638 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-c800e14b-66d5-476b-b221-9f6a91de7bbf tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8f887f5689419e9e31a0ba43f76ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62d19c831574f9b99c993b5e41c645d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:30:33.372671 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-c4c2f68d-528f-408a-a1ac-2520ad8f94b3 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965cf2aad5bc4def9fca55aac87cc37e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32569df1dca45cebcdd63d03ff5abae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:30:33.374804 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-c800e14b-66d5-476b-b221-9f6a91de7bbf tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] 10.222.0.46 "GET /compute/v2.1/servers/b1a612df-55d1-4106-951d-7f0ea95cfe83" status: 200 len: 1522 microversion: 2.1 time: 0.290645 Aug 04 05:30:33.375766 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 279/558] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:30:33 2022] GET /compute/v2.1/servers/b1a612df-55d1-4106-951d-7f0ea95cfe83 => generated 1522 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:30:33.386674 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-8e0865fe-97bb-46ae-ad27-8726bce91c49 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:30:33.387199 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-c4c2f68d-528f-408a-a1ac-2520ad8f94b3 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] 10.222.0.46 "GET /compute/v2.1/servers/8558ff08-5004-4dc4-892d-5b6610ce6bec" status: 200 len: 1569 microversion: 2.1 time: 0.289293 Aug 04 05:30:33.391788 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-8e0865fe-97bb-46ae-ad27-8726bce91c49 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] [instance: b45583dc-f18b-4b4a-98e3-ef1bdcf41f80] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:30:33.392295 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 280/559] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:30:33 2022] GET /compute/v2.1/servers/8558ff08-5004-4dc4-892d-5b6610ce6bec => generated 1569 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 05:30:33.400869 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-8e0865fe-97bb-46ae-ad27-8726bce91c49 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:30:33.401370 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-8e0865fe-97bb-46ae-ad27-8726bce91c49 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:30:33.402698 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-8e0865fe-97bb-46ae-ad27-8726bce91c49 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:30:33.403540 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-8e0865fe-97bb-46ae-ad27-8726bce91c49 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:30:33.439719 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-8e0865fe-97bb-46ae-ad27-8726bce91c49 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] 10.222.0.46 "GET /compute/v2.1/servers/b45583dc-f18b-4b4a-98e3-ef1bdcf41f80/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.062250 Aug 04 05:30:33.441446 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 280/560] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Aug 4 05:30:33 2022] GET /compute/v2.1/servers/b45583dc-f18b-4b4a-98e3-ef1bdcf41f80/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:30:34.024937 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-e540100b-b4ad-4832-8769-e03c21d7c7fe tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:30:34.025636 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-e540100b-b4ad-4832-8769-e03c21d7c7fe tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] [instance: 4edbad4c-dfb3-43c9-992d-f2b2b4744d94] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:30:34.032656 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-e540100b-b4ad-4832-8769-e03c21d7c7fe tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:30:34.033097 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-e540100b-b4ad-4832-8769-e03c21d7c7fe tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:30:34.033872 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-e540100b-b4ad-4832-8769-e03c21d7c7fe tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:30:34.034323 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-e540100b-b4ad-4832-8769-e03c21d7c7fe tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:30:34.174836 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-e540100b-b4ad-4832-8769-e03c21d7c7fe tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5af2248451d3483d9742887d614a5077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520d3d5e2e804be1bd5dc9bfc50c5de8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:30:34.183366 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-e540100b-b4ad-4832-8769-e03c21d7c7fe tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] 10.222.0.46 "GET /compute/v2.1/servers/4edbad4c-dfb3-43c9-992d-f2b2b4744d94" status: 200 len: 1513 microversion: 2.1 time: 0.162821 Aug 04 05:30:34.183942 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 281/561] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:30:34 2022] GET /compute/v2.1/servers/4edbad4c-dfb3-43c9-992d-f2b2b4744d94 => generated 1513 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:30:34.398721 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-f4c52d2f-baa8-4fd5-9bd8-2f86ba0c5b7b tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:30:34.399569 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-f4c52d2f-baa8-4fd5-9bd8-2f86ba0c5b7b tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] [instance: b1a612df-55d1-4106-951d-7f0ea95cfe83] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:30:34.406609 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-f4c52d2f-baa8-4fd5-9bd8-2f86ba0c5b7b tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:30:34.407222 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-f4c52d2f-baa8-4fd5-9bd8-2f86ba0c5b7b tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:30:34.408076 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-f4c52d2f-baa8-4fd5-9bd8-2f86ba0c5b7b tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:30:34.408520 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-f4c52d2f-baa8-4fd5-9bd8-2f86ba0c5b7b tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:30:34.412013 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-9e4d7074-f036-4adc-a4d1-a7ec258b4b5f tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:30:34.412668 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-9e4d7074-f036-4adc-a4d1-a7ec258b4b5f tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] [instance: 8558ff08-5004-4dc4-892d-5b6610ce6bec] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:30:34.419601 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-9e4d7074-f036-4adc-a4d1-a7ec258b4b5f tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:30:34.420023 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-9e4d7074-f036-4adc-a4d1-a7ec258b4b5f tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:30:34.420759 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-9e4d7074-f036-4adc-a4d1-a7ec258b4b5f tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:30:34.421201 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-9e4d7074-f036-4adc-a4d1-a7ec258b4b5f tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:30:34.608934 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-f4c52d2f-baa8-4fd5-9bd8-2f86ba0c5b7b tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8f887f5689419e9e31a0ba43f76ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62d19c831574f9b99c993b5e41c645d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:30:34.616467 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-f4c52d2f-baa8-4fd5-9bd8-2f86ba0c5b7b tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] 10.222.0.46 "GET /compute/v2.1/servers/b1a612df-55d1-4106-951d-7f0ea95cfe83" status: 200 len: 1522 microversion: 2.1 time: 0.221728 Aug 04 05:30:34.617788 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 281/562] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:30:34 2022] GET /compute/v2.1/servers/b1a612df-55d1-4106-951d-7f0ea95cfe83 => generated 1522 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:30:34.622782 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-603e40a5-93ab-4fab-aac4-948e24cba6fa tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:30:34.624963 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-603e40a5-93ab-4fab-aac4-948e24cba6fa tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] [instance: b45583dc-f18b-4b4a-98e3-ef1bdcf41f80] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:30:34.631687 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-603e40a5-93ab-4fab-aac4-948e24cba6fa tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:30:34.633223 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-603e40a5-93ab-4fab-aac4-948e24cba6fa tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:30:34.634111 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-603e40a5-93ab-4fab-aac4-948e24cba6fa tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:30:34.634712 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-603e40a5-93ab-4fab-aac4-948e24cba6fa tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:30:34.641933 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-9e4d7074-f036-4adc-a4d1-a7ec258b4b5f tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965cf2aad5bc4def9fca55aac87cc37e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32569df1dca45cebcdd63d03ff5abae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:30:34.650221 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-9e4d7074-f036-4adc-a4d1-a7ec258b4b5f tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] 10.222.0.46 "GET /compute/v2.1/servers/8558ff08-5004-4dc4-892d-5b6610ce6bec" status: 200 len: 1569 microversion: 2.1 time: 0.242069 Aug 04 05:30:34.650770 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 282/563] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:30:34 2022] GET /compute/v2.1/servers/8558ff08-5004-4dc4-892d-5b6610ce6bec => generated 1569 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:30:34.666856 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-603e40a5-93ab-4fab-aac4-948e24cba6fa tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] 10.222.0.46 "GET /compute/v2.1/servers/b45583dc-f18b-4b4a-98e3-ef1bdcf41f80/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047786 Aug 04 05:30:34.667427 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 282/564] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Aug 4 05:30:34 2022] GET /compute/v2.1/servers/b45583dc-f18b-4b4a-98e3-ef1bdcf41f80/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:30:35.205109 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-4ea510a0-8d75-400e-8e8f-d606a2cff8dc tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:30:35.206108 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-4ea510a0-8d75-400e-8e8f-d606a2cff8dc tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] [instance: 4edbad4c-dfb3-43c9-992d-f2b2b4744d94] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:30:35.214010 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-4ea510a0-8d75-400e-8e8f-d606a2cff8dc tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:30:35.214484 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-4ea510a0-8d75-400e-8e8f-d606a2cff8dc tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:30:35.215251 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-4ea510a0-8d75-400e-8e8f-d606a2cff8dc tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:30:35.215680 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-4ea510a0-8d75-400e-8e8f-d606a2cff8dc tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:30:35.345940 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-f10ade79-c5a5-4c5b-b5f5-c98df41a9769 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:30:35.348837 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-f10ade79-c5a5-4c5b-b5f5-c98df41a9769 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] [instance: 9333850c-071c-4330-98b9-84232a752ffe] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:30:35.356717 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-f10ade79-c5a5-4c5b-b5f5-c98df41a9769 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:30:35.357164 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-f10ade79-c5a5-4c5b-b5f5-c98df41a9769 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:30:35.357998 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-f10ade79-c5a5-4c5b-b5f5-c98df41a9769 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:30:35.358392 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-f10ade79-c5a5-4c5b-b5f5-c98df41a9769 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:30:35.360434 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-4ea510a0-8d75-400e-8e8f-d606a2cff8dc tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5af2248451d3483d9742887d614a5077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520d3d5e2e804be1bd5dc9bfc50c5de8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:30:35.368878 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-4ea510a0-8d75-400e-8e8f-d606a2cff8dc tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] 10.222.0.46 "GET /compute/v2.1/servers/4edbad4c-dfb3-43c9-992d-f2b2b4744d94" status: 200 len: 1513 microversion: 2.1 time: 0.167544 Aug 04 05:30:35.369493 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 283/565] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:30:35 2022] GET /compute/v2.1/servers/4edbad4c-dfb3-43c9-992d-f2b2b4744d94 => generated 1513 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:30:35.390654 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-f10ade79-c5a5-4c5b-b5f5-c98df41a9769 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] 10.222.0.46 "GET /compute/v2.1/servers/9333850c-071c-4330-98b9-84232a752ffe/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.051007 Aug 04 05:30:35.391236 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 283/566] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Aug 4 05:30:35 2022] GET /compute/v2.1/servers/9333850c-071c-4330-98b9-84232a752ffe/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 04 05:30:35.455214 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-6c0e32fa-a763-4b03-b43c-82b39ff777b4 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:30:35.455741 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-6c0e32fa-a763-4b03-b43c-82b39ff777b4 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] [instance: 9333850c-071c-4330-98b9-84232a752ffe] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:30:35.461917 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-6c0e32fa-a763-4b03-b43c-82b39ff777b4 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:30:35.462386 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-6c0e32fa-a763-4b03-b43c-82b39ff777b4 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:30:35.463149 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-6c0e32fa-a763-4b03-b43c-82b39ff777b4 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:30:35.463582 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-6c0e32fa-a763-4b03-b43c-82b39ff777b4 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:30:35.466333 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG dbcounter [-] [118477] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=118477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:30:35.491409 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-6c0e32fa-a763-4b03-b43c-82b39ff777b4 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] [instance: 9333850c-071c-4330-98b9-84232a752ffe] Going to try to terminate instance {{(pid=118477) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 05:30:35.639694 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-bf61a9e5-b9d3-4efe-bae2-19931b9823dc tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:30:35.640300 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-bf61a9e5-b9d3-4efe-bae2-19931b9823dc tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] [instance: b1a612df-55d1-4106-951d-7f0ea95cfe83] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:30:35.646526 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-bf61a9e5-b9d3-4efe-bae2-19931b9823dc tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:30:35.649434 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-bf61a9e5-b9d3-4efe-bae2-19931b9823dc tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:30:35.649434 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-bf61a9e5-b9d3-4efe-bae2-19931b9823dc tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:30:35.649434 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-bf61a9e5-b9d3-4efe-bae2-19931b9823dc tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:30:35.789088 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-6c0e32fa-a763-4b03-b43c-82b39ff777b4 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] 10.222.0.46 "DELETE /compute/v2.1/servers/9333850c-071c-4330-98b9-84232a752ffe" status: 204 len: 0 microversion: 2.1 time: 0.336923 Aug 04 05:30:35.789688 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 284/567] 10.222.0.46 () {58 vars in 1239 bytes} [Thu Aug 4 05:30:35 2022] DELETE /compute/v2.1/servers/9333850c-071c-4330-98b9-84232a752ffe => generated 0 bytes in 339 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 05:30:35.795148 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-7ed98e8b-3699-42fe-bbb9-56a76dd7c2bb tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:30:35.795848 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-7ed98e8b-3699-42fe-bbb9-56a76dd7c2bb tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] [instance: 8558ff08-5004-4dc4-892d-5b6610ce6bec] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:30:35.800724 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-bf61a9e5-b9d3-4efe-bae2-19931b9823dc tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8f887f5689419e9e31a0ba43f76ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62d19c831574f9b99c993b5e41c645d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:30:35.801997 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-7ed98e8b-3699-42fe-bbb9-56a76dd7c2bb tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:30:35.802536 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-7ed98e8b-3699-42fe-bbb9-56a76dd7c2bb tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:30:35.803286 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-7ed98e8b-3699-42fe-bbb9-56a76dd7c2bb tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:30:35.803714 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-7ed98e8b-3699-42fe-bbb9-56a76dd7c2bb tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:30:35.811246 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-bf61a9e5-b9d3-4efe-bae2-19931b9823dc tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] 10.222.0.46 "GET /compute/v2.1/servers/b1a612df-55d1-4106-951d-7f0ea95cfe83" status: 200 len: 1522 microversion: 2.1 time: 0.175321 Aug 04 05:30:35.811837 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 284/568] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:30:35 2022] GET /compute/v2.1/servers/b1a612df-55d1-4106-951d-7f0ea95cfe83 => generated 1522 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 05:30:35.816617 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-97a28fa9-8e95-4881-8808-6dd2c265ebd8 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:30:35.818845 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-97a28fa9-8e95-4881-8808-6dd2c265ebd8 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] [instance: b45583dc-f18b-4b4a-98e3-ef1bdcf41f80] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:30:35.825484 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-97a28fa9-8e95-4881-8808-6dd2c265ebd8 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:30:35.825929 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-97a28fa9-8e95-4881-8808-6dd2c265ebd8 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:30:35.826784 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-97a28fa9-8e95-4881-8808-6dd2c265ebd8 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:30:35.827326 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-97a28fa9-8e95-4881-8808-6dd2c265ebd8 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:30:35.860663 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-97a28fa9-8e95-4881-8808-6dd2c265ebd8 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] 10.222.0.46 "GET /compute/v2.1/servers/b45583dc-f18b-4b4a-98e3-ef1bdcf41f80/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047741 Aug 04 05:30:35.861253 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 285/569] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Aug 4 05:30:35 2022] GET /compute/v2.1/servers/b45583dc-f18b-4b4a-98e3-ef1bdcf41f80/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:30:35.867855 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-dda775ef-1b33-41d1-b07b-7bfe6b7216b1 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:30:35.868078 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-dda775ef-1b33-41d1-b07b-7bfe6b7216b1 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] [instance: 9333850c-071c-4330-98b9-84232a752ffe] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:30:35.875985 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-dda775ef-1b33-41d1-b07b-7bfe6b7216b1 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:30:35.876538 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-dda775ef-1b33-41d1-b07b-7bfe6b7216b1 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:30:35.877404 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-dda775ef-1b33-41d1-b07b-7bfe6b7216b1 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:30:35.877933 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-dda775ef-1b33-41d1-b07b-7bfe6b7216b1 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:30:35.995081 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-7ed98e8b-3699-42fe-bbb9-56a76dd7c2bb tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965cf2aad5bc4def9fca55aac87cc37e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32569df1dca45cebcdd63d03ff5abae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:30:36.003031 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-7ed98e8b-3699-42fe-bbb9-56a76dd7c2bb tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] 10.222.0.46 "GET /compute/v2.1/servers/8558ff08-5004-4dc4-892d-5b6610ce6bec" status: 200 len: 1569 microversion: 2.1 time: 0.212120 Aug 04 05:30:36.003624 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 285/570] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:30:35 2022] GET /compute/v2.1/servers/8558ff08-5004-4dc4-892d-5b6610ce6bec => generated 1569 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:30:36.045938 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-dda775ef-1b33-41d1-b07b-7bfe6b7216b1 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb4dea95659c473b9b193c6234186430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1ca4b83dc874bda9f33e06f4910608c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:30:36.053815 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-dda775ef-1b33-41d1-b07b-7bfe6b7216b1 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] 10.222.0.46 "GET /compute/v2.1/servers/9333850c-071c-4330-98b9-84232a752ffe" status: 200 len: 1673 microversion: 2.1 time: 0.191577 Aug 04 05:30:36.055196 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 286/571] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:30:35 2022] GET /compute/v2.1/servers/9333850c-071c-4330-98b9-84232a752ffe => generated 1673 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:30:36.392692 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-6d10fd31-a958-4c13-a436-0d5ff8e847a8 tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:30:36.393308 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-6d10fd31-a958-4c13-a436-0d5ff8e847a8 tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] [instance: 4edbad4c-dfb3-43c9-992d-f2b2b4744d94] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:30:36.400954 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-6d10fd31-a958-4c13-a436-0d5ff8e847a8 tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:30:36.401399 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-6d10fd31-a958-4c13-a436-0d5ff8e847a8 tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:30:36.402178 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-6d10fd31-a958-4c13-a436-0d5ff8e847a8 tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:30:36.402631 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-6d10fd31-a958-4c13-a436-0d5ff8e847a8 tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:30:36.540634 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-6d10fd31-a958-4c13-a436-0d5ff8e847a8 tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5af2248451d3483d9742887d614a5077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520d3d5e2e804be1bd5dc9bfc50c5de8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:30:36.549161 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-6d10fd31-a958-4c13-a436-0d5ff8e847a8 tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] 10.222.0.46 "GET /compute/v2.1/servers/4edbad4c-dfb3-43c9-992d-f2b2b4744d94" status: 200 len: 1513 microversion: 2.1 time: 0.160384 Aug 04 05:30:36.549770 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 286/572] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:30:36 2022] GET /compute/v2.1/servers/4edbad4c-dfb3-43c9-992d-f2b2b4744d94 => generated 1513 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:30:36.833147 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-e859225f-57a7-4777-bd1b-a832b47e3628 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:30:36.833695 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-e859225f-57a7-4777-bd1b-a832b47e3628 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] [instance: b1a612df-55d1-4106-951d-7f0ea95cfe83] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:30:36.841640 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-e859225f-57a7-4777-bd1b-a832b47e3628 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:30:36.842083 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-e859225f-57a7-4777-bd1b-a832b47e3628 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:30:36.842881 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-e859225f-57a7-4777-bd1b-a832b47e3628 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:30:36.843308 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-e859225f-57a7-4777-bd1b-a832b47e3628 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:30:36.873776 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-7cf9f333-b293-4724-9c25-12e642b8407e tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:30:36.876112 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-7cf9f333-b293-4724-9c25-12e642b8407e tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] [instance: b45583dc-f18b-4b4a-98e3-ef1bdcf41f80] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:30:36.883102 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-7cf9f333-b293-4724-9c25-12e642b8407e tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:30:36.883561 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-7cf9f333-b293-4724-9c25-12e642b8407e tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:30:36.884369 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-7cf9f333-b293-4724-9c25-12e642b8407e tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:30:36.884805 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-7cf9f333-b293-4724-9c25-12e642b8407e tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:30:36.918549 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-7cf9f333-b293-4724-9c25-12e642b8407e tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] 10.222.0.46 "GET /compute/v2.1/servers/b45583dc-f18b-4b4a-98e3-ef1bdcf41f80/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048555 Aug 04 05:30:36.919132 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 287/573] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Aug 4 05:30:36 2022] GET /compute/v2.1/servers/b45583dc-f18b-4b4a-98e3-ef1bdcf41f80/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 05:30:36.998288 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-e859225f-57a7-4777-bd1b-a832b47e3628 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8f887f5689419e9e31a0ba43f76ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62d19c831574f9b99c993b5e41c645d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:30:37.007206 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-e859225f-57a7-4777-bd1b-a832b47e3628 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] 10.222.0.46 "GET /compute/v2.1/servers/b1a612df-55d1-4106-951d-7f0ea95cfe83" status: 200 len: 1522 microversion: 2.1 time: 0.177930 Aug 04 05:30:37.007830 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 287/574] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:30:36 2022] GET /compute/v2.1/servers/b1a612df-55d1-4106-951d-7f0ea95cfe83 => generated 1522 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:30:37.024650 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-defebf75-e954-46f9-b394-4281e71f9688 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:30:37.025255 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-defebf75-e954-46f9-b394-4281e71f9688 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] [instance: 8558ff08-5004-4dc4-892d-5b6610ce6bec] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:30:37.031632 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-defebf75-e954-46f9-b394-4281e71f9688 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:30:37.032177 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-defebf75-e954-46f9-b394-4281e71f9688 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:30:37.032826 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-defebf75-e954-46f9-b394-4281e71f9688 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:30:37.033248 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-defebf75-e954-46f9-b394-4281e71f9688 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:30:37.079870 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-a711934f-c3b4-4191-85ee-f3019f06a75c tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:30:37.080947 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-a711934f-c3b4-4191-85ee-f3019f06a75c tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] [instance: 9333850c-071c-4330-98b9-84232a752ffe] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:30:37.091215 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-a711934f-c3b4-4191-85ee-f3019f06a75c tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:30:37.091520 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-a711934f-c3b4-4191-85ee-f3019f06a75c tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:30:37.092506 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-a711934f-c3b4-4191-85ee-f3019f06a75c tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:30:37.093071 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-a711934f-c3b4-4191-85ee-f3019f06a75c tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:30:37.216009 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-defebf75-e954-46f9-b394-4281e71f9688 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965cf2aad5bc4def9fca55aac87cc37e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32569df1dca45cebcdd63d03ff5abae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:30:37.225179 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-defebf75-e954-46f9-b394-4281e71f9688 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] 10.222.0.46 "GET /compute/v2.1/servers/8558ff08-5004-4dc4-892d-5b6610ce6bec" status: 200 len: 1569 microversion: 2.1 time: 0.205215 Aug 04 05:30:37.225764 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 288/575] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:30:37 2022] GET /compute/v2.1/servers/8558ff08-5004-4dc4-892d-5b6610ce6bec => generated 1569 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:30:37.261956 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-a711934f-c3b4-4191-85ee-f3019f06a75c tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb4dea95659c473b9b193c6234186430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1ca4b83dc874bda9f33e06f4910608c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:30:37.270659 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-a711934f-c3b4-4191-85ee-f3019f06a75c tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] 10.222.0.46 "GET /compute/v2.1/servers/9333850c-071c-4330-98b9-84232a752ffe" status: 200 len: 1673 microversion: 2.1 time: 0.197480 Aug 04 05:30:37.271268 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 288/576] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:30:37 2022] GET /compute/v2.1/servers/9333850c-071c-4330-98b9-84232a752ffe => generated 1673 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 05:30:37.572473 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-d2c0abf7-44db-4947-9221-a569d443d060 tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:30:37.573106 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-d2c0abf7-44db-4947-9221-a569d443d060 tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] [instance: 4edbad4c-dfb3-43c9-992d-f2b2b4744d94] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:30:37.579945 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-d2c0abf7-44db-4947-9221-a569d443d060 tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:30:37.580405 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-d2c0abf7-44db-4947-9221-a569d443d060 tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:30:37.581182 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-d2c0abf7-44db-4947-9221-a569d443d060 tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:30:37.581618 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-d2c0abf7-44db-4947-9221-a569d443d060 tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:30:37.721952 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-d2c0abf7-44db-4947-9221-a569d443d060 tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5af2248451d3483d9742887d614a5077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520d3d5e2e804be1bd5dc9bfc50c5de8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:30:37.730470 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-d2c0abf7-44db-4947-9221-a569d443d060 tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] 10.222.0.46 "GET /compute/v2.1/servers/4edbad4c-dfb3-43c9-992d-f2b2b4744d94" status: 200 len: 1513 microversion: 2.1 time: 0.162569 Aug 04 05:30:37.738375 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 289/577] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:30:37 2022] GET /compute/v2.1/servers/4edbad4c-dfb3-43c9-992d-f2b2b4744d94 => generated 1513 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:30:37.932156 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-5142db71-6e59-406a-9dd4-32bace1a3245 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:30:37.934286 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-5142db71-6e59-406a-9dd4-32bace1a3245 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] [instance: b45583dc-f18b-4b4a-98e3-ef1bdcf41f80] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:30:37.936721 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG dbcounter [-] [118476] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=3 {{(pid=118476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:30:37.941441 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-5142db71-6e59-406a-9dd4-32bace1a3245 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:30:37.941888 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-5142db71-6e59-406a-9dd4-32bace1a3245 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:30:37.942683 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-5142db71-6e59-406a-9dd4-32bace1a3245 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:30:37.943116 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-5142db71-6e59-406a-9dd4-32bace1a3245 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:30:37.974334 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-5142db71-6e59-406a-9dd4-32bace1a3245 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] 10.222.0.46 "GET /compute/v2.1/servers/b45583dc-f18b-4b4a-98e3-ef1bdcf41f80/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046970 Aug 04 05:30:37.974916 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 289/578] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Aug 4 05:30:37 2022] GET /compute/v2.1/servers/b45583dc-f18b-4b4a-98e3-ef1bdcf41f80/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:30:38.032099 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-dde0d7ff-f2fb-4a70-a4fe-41432cd2f5e0 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:30:38.032711 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-dde0d7ff-f2fb-4a70-a4fe-41432cd2f5e0 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] [instance: b1a612df-55d1-4106-951d-7f0ea95cfe83] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:30:38.039285 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-dde0d7ff-f2fb-4a70-a4fe-41432cd2f5e0 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:30:38.039733 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-dde0d7ff-f2fb-4a70-a4fe-41432cd2f5e0 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:30:38.040505 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-dde0d7ff-f2fb-4a70-a4fe-41432cd2f5e0 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:30:38.040935 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-dde0d7ff-f2fb-4a70-a4fe-41432cd2f5e0 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:30:38.180084 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-dde0d7ff-f2fb-4a70-a4fe-41432cd2f5e0 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8f887f5689419e9e31a0ba43f76ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62d19c831574f9b99c993b5e41c645d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:30:38.187681 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-dde0d7ff-f2fb-4a70-a4fe-41432cd2f5e0 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] 10.222.0.46 "GET /compute/v2.1/servers/b1a612df-55d1-4106-951d-7f0ea95cfe83" status: 200 len: 1522 microversion: 2.1 time: 0.159607 Aug 04 05:30:38.188188 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 290/579] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:30:38 2022] GET /compute/v2.1/servers/b1a612df-55d1-4106-951d-7f0ea95cfe83 => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:30:38.248109 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-a1f607d5-0e83-4b0d-9df9-c45d2ee01b88 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:30:38.248712 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-a1f607d5-0e83-4b0d-9df9-c45d2ee01b88 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] [instance: 8558ff08-5004-4dc4-892d-5b6610ce6bec] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:30:38.255037 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-a1f607d5-0e83-4b0d-9df9-c45d2ee01b88 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:30:38.255480 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-a1f607d5-0e83-4b0d-9df9-c45d2ee01b88 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:30:38.256236 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-a1f607d5-0e83-4b0d-9df9-c45d2ee01b88 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:30:38.256672 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-a1f607d5-0e83-4b0d-9df9-c45d2ee01b88 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:30:38.272112 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG dbcounter [-] [118476] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:30:38.293841 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-652d443a-eb00-43c1-b075-12601a0f57e9 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:30:38.294553 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-652d443a-eb00-43c1-b075-12601a0f57e9 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] [instance: 9333850c-071c-4330-98b9-84232a752ffe] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:30:38.300912 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-652d443a-eb00-43c1-b075-12601a0f57e9 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:30:38.301442 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-652d443a-eb00-43c1-b075-12601a0f57e9 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:30:38.302231 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-652d443a-eb00-43c1-b075-12601a0f57e9 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:30:38.302702 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-652d443a-eb00-43c1-b075-12601a0f57e9 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:30:38.458044 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-a1f607d5-0e83-4b0d-9df9-c45d2ee01b88 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965cf2aad5bc4def9fca55aac87cc37e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32569df1dca45cebcdd63d03ff5abae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:30:38.466695 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-a1f607d5-0e83-4b0d-9df9-c45d2ee01b88 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] 10.222.0.46 "GET /compute/v2.1/servers/8558ff08-5004-4dc4-892d-5b6610ce6bec" status: 200 len: 1569 microversion: 2.1 time: 0.223042 Aug 04 05:30:38.467272 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 290/580] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:30:38 2022] GET /compute/v2.1/servers/8558ff08-5004-4dc4-892d-5b6610ce6bec => generated 1569 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:30:38.480336 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-652d443a-eb00-43c1-b075-12601a0f57e9 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb4dea95659c473b9b193c6234186430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1ca4b83dc874bda9f33e06f4910608c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:30:38.487740 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-652d443a-eb00-43c1-b075-12601a0f57e9 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] 10.222.0.46 "GET /compute/v2.1/servers/9333850c-071c-4330-98b9-84232a752ffe" status: 200 len: 1673 microversion: 2.1 time: 0.197806 Aug 04 05:30:38.488298 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 291/581] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:30:38 2022] GET /compute/v2.1/servers/9333850c-071c-4330-98b9-84232a752ffe => generated 1673 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 05:30:38.752606 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-233d6f30-8771-4213-9ca6-100a8d8a989e tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:30:38.753246 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-233d6f30-8771-4213-9ca6-100a8d8a989e tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] [instance: 4edbad4c-dfb3-43c9-992d-f2b2b4744d94] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:30:38.760416 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-233d6f30-8771-4213-9ca6-100a8d8a989e tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:30:38.760855 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-233d6f30-8771-4213-9ca6-100a8d8a989e tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:30:38.761607 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-233d6f30-8771-4213-9ca6-100a8d8a989e tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:30:38.762035 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-233d6f30-8771-4213-9ca6-100a8d8a989e tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:30:38.894970 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-233d6f30-8771-4213-9ca6-100a8d8a989e tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5af2248451d3483d9742887d614a5077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520d3d5e2e804be1bd5dc9bfc50c5de8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:30:38.903766 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-233d6f30-8771-4213-9ca6-100a8d8a989e tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] 10.222.0.46 "GET /compute/v2.1/servers/4edbad4c-dfb3-43c9-992d-f2b2b4744d94" status: 200 len: 1513 microversion: 2.1 time: 0.155059 Aug 04 05:30:38.904337 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 291/582] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:30:38 2022] GET /compute/v2.1/servers/4edbad4c-dfb3-43c9-992d-f2b2b4744d94 => generated 1513 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:30:38.986817 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-c9c57ab8-d9ed-45ad-b76d-32fdf70415c1 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:30:38.989056 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-c9c57ab8-d9ed-45ad-b76d-32fdf70415c1 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] [instance: b45583dc-f18b-4b4a-98e3-ef1bdcf41f80] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:30:38.995576 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-c9c57ab8-d9ed-45ad-b76d-32fdf70415c1 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:30:38.996019 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-c9c57ab8-d9ed-45ad-b76d-32fdf70415c1 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:30:38.996774 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-c9c57ab8-d9ed-45ad-b76d-32fdf70415c1 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:30:38.997196 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-c9c57ab8-d9ed-45ad-b76d-32fdf70415c1 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:30:39.026693 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-c9c57ab8-d9ed-45ad-b76d-32fdf70415c1 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] 10.222.0.46 "GET /compute/v2.1/servers/b45583dc-f18b-4b4a-98e3-ef1bdcf41f80/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043641 Aug 04 05:30:39.027171 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 292/583] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Aug 4 05:30:38 2022] GET /compute/v2.1/servers/b45583dc-f18b-4b4a-98e3-ef1bdcf41f80/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:30:39.209087 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-59524f13-06f4-451b-8e5d-803bebe2ed4a tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:30:39.209687 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-59524f13-06f4-451b-8e5d-803bebe2ed4a tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] [instance: b1a612df-55d1-4106-951d-7f0ea95cfe83] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:30:39.216877 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-59524f13-06f4-451b-8e5d-803bebe2ed4a tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:30:39.217320 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-59524f13-06f4-451b-8e5d-803bebe2ed4a tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:30:39.218078 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-59524f13-06f4-451b-8e5d-803bebe2ed4a tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:30:39.218544 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-59524f13-06f4-451b-8e5d-803bebe2ed4a tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:30:39.354368 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-59524f13-06f4-451b-8e5d-803bebe2ed4a tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8f887f5689419e9e31a0ba43f76ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62d19c831574f9b99c993b5e41c645d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:30:39.361839 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-59524f13-06f4-451b-8e5d-803bebe2ed4a tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] 10.222.0.46 "GET /compute/v2.1/servers/b1a612df-55d1-4106-951d-7f0ea95cfe83" status: 200 len: 1522 microversion: 2.1 time: 0.156642 Aug 04 05:30:39.362606 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 292/584] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:30:39 2022] GET /compute/v2.1/servers/b1a612df-55d1-4106-951d-7f0ea95cfe83 => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:30:39.488835 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-1fd8c85b-0d42-465e-8ccf-c2463e01cbe3 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:30:39.489442 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-1fd8c85b-0d42-465e-8ccf-c2463e01cbe3 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] [instance: 8558ff08-5004-4dc4-892d-5b6610ce6bec] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:30:39.496490 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-1fd8c85b-0d42-465e-8ccf-c2463e01cbe3 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:30:39.496930 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-1fd8c85b-0d42-465e-8ccf-c2463e01cbe3 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:30:39.497694 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-1fd8c85b-0d42-465e-8ccf-c2463e01cbe3 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:30:39.498124 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-1fd8c85b-0d42-465e-8ccf-c2463e01cbe3 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:30:39.510184 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-9cc33c15-42cf-46eb-be48-1e0ceaa70d35 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:30:39.510814 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-9cc33c15-42cf-46eb-be48-1e0ceaa70d35 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] [instance: 9333850c-071c-4330-98b9-84232a752ffe] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:30:39.517499 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-9cc33c15-42cf-46eb-be48-1e0ceaa70d35 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:30:39.517872 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-9cc33c15-42cf-46eb-be48-1e0ceaa70d35 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:30:39.518714 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-9cc33c15-42cf-46eb-be48-1e0ceaa70d35 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:30:39.519132 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-9cc33c15-42cf-46eb-be48-1e0ceaa70d35 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:30:39.769802 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-1fd8c85b-0d42-465e-8ccf-c2463e01cbe3 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965cf2aad5bc4def9fca55aac87cc37e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32569df1dca45cebcdd63d03ff5abae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:30:39.779971 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-1fd8c85b-0d42-465e-8ccf-c2463e01cbe3 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] 10.222.0.46 "GET /compute/v2.1/servers/8558ff08-5004-4dc4-892d-5b6610ce6bec" status: 200 len: 1569 microversion: 2.1 time: 0.294981 Aug 04 05:30:39.781399 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 293/585] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:30:39 2022] GET /compute/v2.1/servers/8558ff08-5004-4dc4-892d-5b6610ce6bec => generated 1569 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:30:39.804243 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-9cc33c15-42cf-46eb-be48-1e0ceaa70d35 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb4dea95659c473b9b193c6234186430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1ca4b83dc874bda9f33e06f4910608c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:30:39.821021 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-9cc33c15-42cf-46eb-be48-1e0ceaa70d35 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] 10.222.0.46 "GET /compute/v2.1/servers/9333850c-071c-4330-98b9-84232a752ffe" status: 200 len: 1673 microversion: 2.1 time: 0.315894 Aug 04 05:30:39.821813 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 293/586] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:30:39 2022] GET /compute/v2.1/servers/9333850c-071c-4330-98b9-84232a752ffe => generated 1673 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:30:39.926262 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-337b6c33-b688-45bf-b9d9-18e8dd4e99ce tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:30:39.927160 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-337b6c33-b688-45bf-b9d9-18e8dd4e99ce tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] [instance: 4edbad4c-dfb3-43c9-992d-f2b2b4744d94] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:30:39.940525 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-337b6c33-b688-45bf-b9d9-18e8dd4e99ce tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:30:39.941043 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-337b6c33-b688-45bf-b9d9-18e8dd4e99ce tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:30:39.941824 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-337b6c33-b688-45bf-b9d9-18e8dd4e99ce tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:30:39.942259 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-337b6c33-b688-45bf-b9d9-18e8dd4e99ce tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:30:40.040340 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-91c63ba7-dc52-4f36-94ff-6ac26f705424 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:30:40.041173 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-91c63ba7-dc52-4f36-94ff-6ac26f705424 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] [instance: b45583dc-f18b-4b4a-98e3-ef1bdcf41f80] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:30:40.053404 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-91c63ba7-dc52-4f36-94ff-6ac26f705424 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:30:40.054677 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-91c63ba7-dc52-4f36-94ff-6ac26f705424 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:30:40.055730 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-91c63ba7-dc52-4f36-94ff-6ac26f705424 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:30:40.058293 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-91c63ba7-dc52-4f36-94ff-6ac26f705424 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:30:40.118135 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-91c63ba7-dc52-4f36-94ff-6ac26f705424 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] 10.222.0.46 "GET /compute/v2.1/servers/b45583dc-f18b-4b4a-98e3-ef1bdcf41f80/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.081623 Aug 04 05:30:40.119516 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 294/587] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Aug 4 05:30:40 2022] GET /compute/v2.1/servers/b45583dc-f18b-4b4a-98e3-ef1bdcf41f80/os-volume_attachments => generated 25 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 04 05:30:40.242573 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [req-b0c57106-b6fa-4952-9b99-c5541f2c2a86 req-92a4e550-87fc-467e-908e-e0d620c0461f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4edbad4c-dfb3-43c9-992d-f2b2b4744d94", "name": "network-vif-unplugged", "status": "completed", "tag": "c0fdc862-1ff5-4496-a3e7-a48010e4accf"}]} {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:30:40.259968 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [req-b0c57106-b6fa-4952-9b99-c5541f2c2a86 req-92a4e550-87fc-467e-908e-e0d620c0461f service nova] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:30:40.260415 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [req-b0c57106-b6fa-4952-9b99-c5541f2c2a86 req-92a4e550-87fc-467e-908e-e0d620c0461f service nova] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:30:40.272261 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.compute.server_external_events [req-b0c57106-b6fa-4952-9b99-c5541f2c2a86 req-92a4e550-87fc-467e-908e-e0d620c0461f service nova] Creating event network-vif-unplugged:c0fdc862-1ff5-4496-a3e7-a48010e4accf for instance 4edbad4c-dfb3-43c9-992d-f2b2b4744d94 on hv-cinder-85207 Aug 04 05:30:40.278436 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [req-b0c57106-b6fa-4952-9b99-c5541f2c2a86 req-92a4e550-87fc-467e-908e-e0d620c0461f service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.040023 Aug 04 05:30:40.282597 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 295/588] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Aug 4 05:30:40 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 05:30:40.285545 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-478ad813-f2ac-4f8e-b152-f3a7c343df82 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:30:40.287280 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-478ad813-f2ac-4f8e-b152-f3a7c343df82 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] [instance: b45583dc-f18b-4b4a-98e3-ef1bdcf41f80] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:30:40.295328 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-478ad813-f2ac-4f8e-b152-f3a7c343df82 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:30:40.296036 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-478ad813-f2ac-4f8e-b152-f3a7c343df82 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:30:40.296990 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-478ad813-f2ac-4f8e-b152-f3a7c343df82 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:30:40.297595 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-478ad813-f2ac-4f8e-b152-f3a7c343df82 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:30:40.389220 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-478ad813-f2ac-4f8e-b152-f3a7c343df82 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] [instance: b45583dc-f18b-4b4a-98e3-ef1bdcf41f80] Going to try to terminate instance {{(pid=118476) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 05:30:40.474941 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-337b6c33-b688-45bf-b9d9-18e8dd4e99ce tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5af2248451d3483d9742887d614a5077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520d3d5e2e804be1bd5dc9bfc50c5de8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:30:40.498541 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-337b6c33-b688-45bf-b9d9-18e8dd4e99ce tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] 10.222.0.46 "GET /compute/v2.1/servers/4edbad4c-dfb3-43c9-992d-f2b2b4744d94" status: 200 len: 1513 microversion: 2.1 time: 0.576652 Aug 04 05:30:40.500221 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 294/589] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:30:39 2022] GET /compute/v2.1/servers/4edbad4c-dfb3-43c9-992d-f2b2b4744d94 => generated 1513 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:30:40.509430 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-24c9fe85-d7bc-45fc-ab0c-da4b05ef3b90 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:30:40.510422 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-24c9fe85-d7bc-45fc-ab0c-da4b05ef3b90 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] [instance: b1a612df-55d1-4106-951d-7f0ea95cfe83] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:30:40.517823 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG dbcounter [-] [118477] Writing DB stats nova_api:SELECT=83,nova_api:DELETE=1,nova_api:UPDATE=2 {{(pid=118477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:30:40.520607 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-24c9fe85-d7bc-45fc-ab0c-da4b05ef3b90 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:30:40.523008 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-24c9fe85-d7bc-45fc-ab0c-da4b05ef3b90 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:30:40.525058 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-24c9fe85-d7bc-45fc-ab0c-da4b05ef3b90 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:30:40.525787 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-24c9fe85-d7bc-45fc-ab0c-da4b05ef3b90 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:30:40.698214 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-24c9fe85-d7bc-45fc-ab0c-da4b05ef3b90 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8f887f5689419e9e31a0ba43f76ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62d19c831574f9b99c993b5e41c645d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:30:40.709972 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-24c9fe85-d7bc-45fc-ab0c-da4b05ef3b90 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] 10.222.0.46 "GET /compute/v2.1/servers/b1a612df-55d1-4106-951d-7f0ea95cfe83" status: 200 len: 1480 microversion: 2.1 time: 0.206346 Aug 04 05:30:40.714984 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 295/590] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:30:40 2022] GET /compute/v2.1/servers/b1a612df-55d1-4106-951d-7f0ea95cfe83 => generated 1480 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:30:40.835983 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-478ad813-f2ac-4f8e-b152-f3a7c343df82 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] 10.222.0.46 "DELETE /compute/v2.1/servers/b45583dc-f18b-4b4a-98e3-ef1bdcf41f80" status: 204 len: 0 microversion: 2.1 time: 0.553999 Aug 04 05:30:40.836835 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 296/591] 10.222.0.46 () {58 vars in 1239 bytes} [Thu Aug 4 05:30:40 2022] DELETE /compute/v2.1/servers/b45583dc-f18b-4b4a-98e3-ef1bdcf41f80 => generated 0 bytes in 557 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 05:30:40.869891 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [req-674fa1d6-1760-4808-bd80-d291ce798f30 req-ca286095-70c6-4dfd-8bc7-485d94ce9a40 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b1a612df-55d1-4106-951d-7f0ea95cfe83", "name": "network-vif-deleted", "tag": "7a8650cf-58ba-4122-b8ba-ce2928ab3c9e"}]} {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:30:40.896488 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [req-674fa1d6-1760-4808-bd80-d291ce798f30 req-ca286095-70c6-4dfd-8bc7-485d94ce9a40 service nova] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:30:40.898766 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [req-674fa1d6-1760-4808-bd80-d291ce798f30 req-ca286095-70c6-4dfd-8bc7-485d94ce9a40 service nova] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:30:40.921076 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.compute.server_external_events [req-674fa1d6-1760-4808-bd80-d291ce798f30 req-ca286095-70c6-4dfd-8bc7-485d94ce9a40 service nova] Creating event network-vif-deleted:7a8650cf-58ba-4122-b8ba-ce2928ab3c9e for instance b1a612df-55d1-4106-951d-7f0ea95cfe83 on hv-cinder-85207 Aug 04 05:30:40.928420 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [req-674fa1d6-1760-4808-bd80-d291ce798f30 req-ca286095-70c6-4dfd-8bc7-485d94ce9a40 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.200126 Aug 04 05:30:40.929765 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 296/592] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Aug 4 05:30:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:30:40.953902 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-f7d0ac43-33c8-4ef8-baaa-1f8ede086a14 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:30:40.954696 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-f7d0ac43-33c8-4ef8-baaa-1f8ede086a14 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] [instance: 8558ff08-5004-4dc4-892d-5b6610ce6bec] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:30:40.956346 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [req-7c872f87-8cb1-4c00-b5b3-36275a738226 req-98d77bc7-2c57-4b6f-9196-0304bff74842 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4edbad4c-dfb3-43c9-992d-f2b2b4744d94", "name": "network-vif-deleted", "tag": "c0fdc862-1ff5-4496-a3e7-a48010e4accf"}]} {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:30:40.963187 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-f7d0ac43-33c8-4ef8-baaa-1f8ede086a14 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:30:40.965552 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-f7d0ac43-33c8-4ef8-baaa-1f8ede086a14 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:30:40.967648 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-f7d0ac43-33c8-4ef8-baaa-1f8ede086a14 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:30:40.967910 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-f7d0ac43-33c8-4ef8-baaa-1f8ede086a14 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:30:40.981683 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [req-7c872f87-8cb1-4c00-b5b3-36275a738226 req-98d77bc7-2c57-4b6f-9196-0304bff74842 service nova] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:30:40.982858 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [req-7c872f87-8cb1-4c00-b5b3-36275a738226 req-98d77bc7-2c57-4b6f-9196-0304bff74842 service nova] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:30:41.004271 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.compute.server_external_events [req-7c872f87-8cb1-4c00-b5b3-36275a738226 req-98d77bc7-2c57-4b6f-9196-0304bff74842 service nova] Creating event network-vif-deleted:c0fdc862-1ff5-4496-a3e7-a48010e4accf for instance 4edbad4c-dfb3-43c9-992d-f2b2b4744d94 on hv-cinder-85207 Aug 04 05:30:41.011261 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [req-7c872f87-8cb1-4c00-b5b3-36275a738226 req-98d77bc7-2c57-4b6f-9196-0304bff74842 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.172504 Aug 04 05:30:41.012117 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 297/593] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Aug 4 05:30:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:30:41.020171 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-bbd5e2a9-2472-4fcc-b1d8-f4afe3962b60 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:30:41.021036 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-bbd5e2a9-2472-4fcc-b1d8-f4afe3962b60 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] [instance: b45583dc-f18b-4b4a-98e3-ef1bdcf41f80] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:30:41.028571 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-bbd5e2a9-2472-4fcc-b1d8-f4afe3962b60 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:30:41.029269 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-bbd5e2a9-2472-4fcc-b1d8-f4afe3962b60 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:30:41.030227 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-bbd5e2a9-2472-4fcc-b1d8-f4afe3962b60 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:30:41.031230 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-bbd5e2a9-2472-4fcc-b1d8-f4afe3962b60 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:30:41.331072 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-bbd5e2a9-2472-4fcc-b1d8-f4afe3962b60 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb49b631c234f9a9fd47049b9b2e097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faead990837d43de8ec54bfaf24361de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:30:41.338062 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-f7d0ac43-33c8-4ef8-baaa-1f8ede086a14 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965cf2aad5bc4def9fca55aac87cc37e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32569df1dca45cebcdd63d03ff5abae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:30:41.343943 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-bbd5e2a9-2472-4fcc-b1d8-f4afe3962b60 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] 10.222.0.46 "GET /compute/v2.1/servers/b45583dc-f18b-4b4a-98e3-ef1bdcf41f80" status: 200 len: 1681 microversion: 2.1 time: 0.330264 Aug 04 05:30:41.349759 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-f7d0ac43-33c8-4ef8-baaa-1f8ede086a14 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] 10.222.0.46 "GET /compute/v2.1/servers/8558ff08-5004-4dc4-892d-5b6610ce6bec" status: 200 len: 1569 microversion: 2.1 time: 0.414516 Aug 04 05:30:41.350391 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 297/594] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:30:40 2022] GET /compute/v2.1/servers/8558ff08-5004-4dc4-892d-5b6610ce6bec => generated 1569 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:30:41.362554 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 298/595] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:30:41 2022] GET /compute/v2.1/servers/b45583dc-f18b-4b4a-98e3-ef1bdcf41f80 => generated 1681 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:30:41.362554 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-3bf68c86-622b-40da-8586-8c665479a306 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:30:41.362554 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-3bf68c86-622b-40da-8586-8c665479a306 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] [instance: 9333850c-071c-4330-98b9-84232a752ffe] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:30:41.370785 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-3bf68c86-622b-40da-8586-8c665479a306 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:30:41.376798 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-3bf68c86-622b-40da-8586-8c665479a306 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:30:41.376798 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-3bf68c86-622b-40da-8586-8c665479a306 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:30:41.376798 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-3bf68c86-622b-40da-8586-8c665479a306 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:30:41.522174 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-766d0336-6c32-4968-b044-07f142d25c87 tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:30:41.523715 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-766d0336-6c32-4968-b044-07f142d25c87 tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] [instance: 4edbad4c-dfb3-43c9-992d-f2b2b4744d94] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:30:41.530681 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-766d0336-6c32-4968-b044-07f142d25c87 tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:30:41.537426 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-766d0336-6c32-4968-b044-07f142d25c87 tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:30:41.537426 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-766d0336-6c32-4968-b044-07f142d25c87 tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:30:41.537426 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-766d0336-6c32-4968-b044-07f142d25c87 tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:30:41.560979 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-3bf68c86-622b-40da-8586-8c665479a306 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb4dea95659c473b9b193c6234186430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1ca4b83dc874bda9f33e06f4910608c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:30:41.569585 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-3bf68c86-622b-40da-8586-8c665479a306 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] 10.222.0.46 "GET /compute/v2.1/servers/9333850c-071c-4330-98b9-84232a752ffe" status: 200 len: 1673 microversion: 2.1 time: 0.213704 Aug 04 05:30:41.571163 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 299/596] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:30:41 2022] GET /compute/v2.1/servers/9333850c-071c-4330-98b9-84232a752ffe => generated 1673 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:30:41.638528 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-766d0336-6c32-4968-b044-07f142d25c87 tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5af2248451d3483d9742887d614a5077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520d3d5e2e804be1bd5dc9bfc50c5de8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:30:41.646483 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-766d0336-6c32-4968-b044-07f142d25c87 tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] 10.222.0.46 "GET /compute/v2.1/servers/4edbad4c-dfb3-43c9-992d-f2b2b4744d94" status: 200 len: 1471 microversion: 2.1 time: 0.128400 Aug 04 05:30:41.647324 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 298/597] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:30:41 2022] GET /compute/v2.1/servers/4edbad4c-dfb3-43c9-992d-f2b2b4744d94 => generated 1471 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 05:30:41.737122 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-b0bfde63-337c-4f52-a493-fd00d120af96 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:30:41.737659 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-b0bfde63-337c-4f52-a493-fd00d120af96 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] [instance: b1a612df-55d1-4106-951d-7f0ea95cfe83] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:30:41.747460 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-b0bfde63-337c-4f52-a493-fd00d120af96 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:30:41.756358 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-b0bfde63-337c-4f52-a493-fd00d120af96 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:30:41.756358 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-b0bfde63-337c-4f52-a493-fd00d120af96 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:30:41.756358 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-b0bfde63-337c-4f52-a493-fd00d120af96 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:30:41.783504 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-b0bfde63-337c-4f52-a493-fd00d120af96 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:30:41.784064 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-b0bfde63-337c-4f52-a493-fd00d120af96 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:30:41.784803 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.objects.instance [None req-b0bfde63-337c-4f52-a493-fd00d120af96 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lazy-loading 'fault' on Instance uuid b1a612df-55d1-4106-951d-7f0ea95cfe83 {{(pid=118476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 05:30:41.838611 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-b0bfde63-337c-4f52-a493-fd00d120af96 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8f887f5689419e9e31a0ba43f76ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62d19c831574f9b99c993b5e41c645d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:30:41.856016 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-b0bfde63-337c-4f52-a493-fd00d120af96 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] 10.222.0.46 "GET /compute/v2.1/servers/b1a612df-55d1-4106-951d-7f0ea95cfe83" status: 200 len: 1312 microversion: 2.1 time: 0.122625 Aug 04 05:30:41.856824 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 300/598] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:30:41 2022] GET /compute/v2.1/servers/b1a612df-55d1-4106-951d-7f0ea95cfe83 => generated 1312 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:30:42.299477 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [req-19f40bfe-38a3-440f-b4fc-d2cc1447525c req-93820c0e-5311-4fde-b063-468e5552cbe2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8558ff08-5004-4dc4-892d-5b6610ce6bec", "name": "network-vif-unplugged", "status": "completed", "tag": "f7d972aa-2cea-4611-b9c7-a3bf2025197a"}]} {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:30:42.313826 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [req-19f40bfe-38a3-440f-b4fc-d2cc1447525c req-93820c0e-5311-4fde-b063-468e5552cbe2 service nova] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:30:42.314266 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [req-19f40bfe-38a3-440f-b4fc-d2cc1447525c req-93820c0e-5311-4fde-b063-468e5552cbe2 service nova] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:30:42.330617 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.compute.server_external_events [req-19f40bfe-38a3-440f-b4fc-d2cc1447525c req-93820c0e-5311-4fde-b063-468e5552cbe2 service nova] Creating event network-vif-unplugged:f7d972aa-2cea-4611-b9c7-a3bf2025197a for instance 8558ff08-5004-4dc4-892d-5b6610ce6bec on hv-cinder-85207 Aug 04 05:30:42.337563 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [req-19f40bfe-38a3-440f-b4fc-d2cc1447525c req-93820c0e-5311-4fde-b063-468e5552cbe2 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.041787 Aug 04 05:30:42.338179 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 299/599] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Aug 4 05:30:42 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 05:30:42.365892 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-dee2bfb5-d48b-4475-9355-18175f3d385f tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:30:42.373597 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-dee2bfb5-d48b-4475-9355-18175f3d385f tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] [instance: b45583dc-f18b-4b4a-98e3-ef1bdcf41f80] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:30:42.382609 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-dee2bfb5-d48b-4475-9355-18175f3d385f tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:30:42.383064 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-dee2bfb5-d48b-4475-9355-18175f3d385f tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:30:42.383851 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-dee2bfb5-d48b-4475-9355-18175f3d385f tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:30:42.384286 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-dee2bfb5-d48b-4475-9355-18175f3d385f tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:30:42.389430 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-70df18ef-738d-499e-897b-a1253df73c62 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:30:42.390231 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-70df18ef-738d-499e-897b-a1253df73c62 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] [instance: 8558ff08-5004-4dc4-892d-5b6610ce6bec] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:30:42.410275 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-70df18ef-738d-499e-897b-a1253df73c62 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:30:42.410754 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-70df18ef-738d-499e-897b-a1253df73c62 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:30:42.411538 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-70df18ef-738d-499e-897b-a1253df73c62 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:30:42.412899 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-70df18ef-738d-499e-897b-a1253df73c62 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:30:42.433590 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG dbcounter [-] [118477] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:30:42.626860 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-dee2bfb5-d48b-4475-9355-18175f3d385f tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb49b631c234f9a9fd47049b9b2e097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faead990837d43de8ec54bfaf24361de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:30:42.638343 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-dee2bfb5-d48b-4475-9355-18175f3d385f tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] 10.222.0.46 "GET /compute/v2.1/servers/b45583dc-f18b-4b4a-98e3-ef1bdcf41f80" status: 200 len: 1681 microversion: 2.1 time: 0.276753 Aug 04 05:30:42.656617 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 301/600] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:30:42 2022] GET /compute/v2.1/servers/b45583dc-f18b-4b4a-98e3-ef1bdcf41f80 => generated 1681 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:30:42.665948 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-da3f4a5c-e05d-4af9-9f62-99460c9cd334 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:30:42.667299 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-da3f4a5c-e05d-4af9-9f62-99460c9cd334 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] [instance: 9333850c-071c-4330-98b9-84232a752ffe] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:30:42.669899 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-70df18ef-738d-499e-897b-a1253df73c62 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965cf2aad5bc4def9fca55aac87cc37e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32569df1dca45cebcdd63d03ff5abae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:30:42.675839 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-da3f4a5c-e05d-4af9-9f62-99460c9cd334 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:30:42.676986 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-da3f4a5c-e05d-4af9-9f62-99460c9cd334 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:30:42.678025 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-da3f4a5c-e05d-4af9-9f62-99460c9cd334 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:30:42.678711 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-da3f4a5c-e05d-4af9-9f62-99460c9cd334 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:30:42.685813 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-70df18ef-738d-499e-897b-a1253df73c62 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] 10.222.0.46 "GET /compute/v2.1/servers/8558ff08-5004-4dc4-892d-5b6610ce6bec" status: 200 len: 1570 microversion: 2.1 time: 0.310350 Aug 04 05:30:42.699987 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 300/601] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:30:42 2022] GET /compute/v2.1/servers/8558ff08-5004-4dc4-892d-5b6610ce6bec => generated 1570 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:30:42.716324 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-808698cb-569e-4cac-a99f-73cafedfdaf2 tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:30:42.716941 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-808698cb-569e-4cac-a99f-73cafedfdaf2 tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] [instance: 4edbad4c-dfb3-43c9-992d-f2b2b4744d94] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:30:42.739084 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-808698cb-569e-4cac-a99f-73cafedfdaf2 tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:30:42.739632 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-808698cb-569e-4cac-a99f-73cafedfdaf2 tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:30:42.740451 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-808698cb-569e-4cac-a99f-73cafedfdaf2 tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:30:42.740881 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-808698cb-569e-4cac-a99f-73cafedfdaf2 tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:30:42.798939 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-808698cb-569e-4cac-a99f-73cafedfdaf2 tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:30:42.800014 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-808698cb-569e-4cac-a99f-73cafedfdaf2 tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:30:42.806530 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.objects.instance [None req-808698cb-569e-4cac-a99f-73cafedfdaf2 tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] Lazy-loading 'fault' on Instance uuid 4edbad4c-dfb3-43c9-992d-f2b2b4744d94 {{(pid=118477) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 05:30:42.853236 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-da3f4a5c-e05d-4af9-9f62-99460c9cd334 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb4dea95659c473b9b193c6234186430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1ca4b83dc874bda9f33e06f4910608c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:30:42.855930 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-da3f4a5c-e05d-4af9-9f62-99460c9cd334 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] 10.222.0.46 "GET /compute/v2.1/servers/9333850c-071c-4330-98b9-84232a752ffe" status: 200 len: 1323 microversion: 2.1 time: 0.197220 Aug 04 05:30:42.856723 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 302/602] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:30:42 2022] GET /compute/v2.1/servers/9333850c-071c-4330-98b9-84232a752ffe => generated 1323 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:30:42.877482 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-aa1ce0a8-8ed3-4439-86cf-32fb615d0652 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:30:42.881562 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-aa1ce0a8-8ed3-4439-86cf-32fb615d0652 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] [instance: 8558ff08-5004-4dc4-892d-5b6610ce6bec] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:30:42.886833 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-808698cb-569e-4cac-a99f-73cafedfdaf2 tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5af2248451d3483d9742887d614a5077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520d3d5e2e804be1bd5dc9bfc50c5de8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:30:42.897330 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-808698cb-569e-4cac-a99f-73cafedfdaf2 tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] 10.222.0.46 "GET /compute/v2.1/servers/4edbad4c-dfb3-43c9-992d-f2b2b4744d94" status: 200 len: 1309 microversion: 2.1 time: 0.189875 Aug 04 05:30:42.900432 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-aa1ce0a8-8ed3-4439-86cf-32fb615d0652 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:30:42.902564 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 301/603] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:30:42 2022] GET /compute/v2.1/servers/4edbad4c-dfb3-43c9-992d-f2b2b4744d94 => generated 1309 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:30:42.910033 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-fe7ebaea-ec59-48c8-8be5-4eba4039fe27 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:30:42.910989 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-aa1ce0a8-8ed3-4439-86cf-32fb615d0652 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:30:42.915033 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-aa1ce0a8-8ed3-4439-86cf-32fb615d0652 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:30:42.915692 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-aa1ce0a8-8ed3-4439-86cf-32fb615d0652 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:30:42.919490 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-fe7ebaea-ec59-48c8-8be5-4eba4039fe27 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] [instance: b1a612df-55d1-4106-951d-7f0ea95cfe83] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:30:42.926684 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-fe7ebaea-ec59-48c8-8be5-4eba4039fe27 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:30:42.927265 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-fe7ebaea-ec59-48c8-8be5-4eba4039fe27 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:30:42.928137 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-fe7ebaea-ec59-48c8-8be5-4eba4039fe27 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:30:42.929660 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-fe7ebaea-ec59-48c8-8be5-4eba4039fe27 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:30:42.967585 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-fe7ebaea-ec59-48c8-8be5-4eba4039fe27 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:30:42.968032 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-fe7ebaea-ec59-48c8-8be5-4eba4039fe27 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:30:42.968490 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.objects.instance [None req-fe7ebaea-ec59-48c8-8be5-4eba4039fe27 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lazy-loading 'fault' on Instance uuid b1a612df-55d1-4106-951d-7f0ea95cfe83 {{(pid=118477) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 05:30:43.036363 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-fe7ebaea-ec59-48c8-8be5-4eba4039fe27 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8f887f5689419e9e31a0ba43f76ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62d19c831574f9b99c993b5e41c645d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:30:43.046213 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-fe7ebaea-ec59-48c8-8be5-4eba4039fe27 tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] 10.222.0.46 "GET /compute/v2.1/servers/b1a612df-55d1-4106-951d-7f0ea95cfe83" status: 200 len: 1312 microversion: 2.1 time: 0.142292 Aug 04 05:30:43.047401 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 302/604] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:30:42 2022] GET /compute/v2.1/servers/b1a612df-55d1-4106-951d-7f0ea95cfe83 => generated 1312 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:30:43.056526 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [req-dfe336e5-30ed-4359-b463-8161106cd212 req-417f2df7-3bc6-4880-b13f-b7c277c49fb3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9333850c-071c-4330-98b9-84232a752ffe", "name": "network-vif-deleted", "tag": "4660aa79-5e1b-4fcd-8608-50d5264cea3e"}]} {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:30:43.068506 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [req-dfe336e5-30ed-4359-b463-8161106cd212 req-417f2df7-3bc6-4880-b13f-b7c277c49fb3 service nova] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:30:43.070827 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [req-dfe336e5-30ed-4359-b463-8161106cd212 req-417f2df7-3bc6-4880-b13f-b7c277c49fb3 service nova] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:30:43.087931 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.compute.server_external_events [req-dfe336e5-30ed-4359-b463-8161106cd212 req-417f2df7-3bc6-4880-b13f-b7c277c49fb3 service nova] Creating event network-vif-deleted:4660aa79-5e1b-4fcd-8608-50d5264cea3e for instance 9333850c-071c-4330-98b9-84232a752ffe on hv-cinder-85207 Aug 04 05:30:43.096626 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [req-dfe336e5-30ed-4359-b463-8161106cd212 req-417f2df7-3bc6-4880-b13f-b7c277c49fb3 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045497 Aug 04 05:30:43.097457 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 303/605] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Aug 4 05:30:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:30:43.115115 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-aa1ce0a8-8ed3-4439-86cf-32fb615d0652 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] [instance: 8558ff08-5004-4dc4-892d-5b6610ce6bec] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=118476) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Aug 04 05:30:43.410344 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-aa1ce0a8-8ed3-4439-86cf-32fb615d0652 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] 10.222.0.46 "POST /compute/v2.1/servers/8558ff08-5004-4dc4-892d-5b6610ce6bec/action" status: 202 len: 0 microversion: 2.1 time: 0.537637 Aug 04 05:30:43.410972 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 303/606] 10.222.0.46 () {60 vars in 1278 bytes} [Thu Aug 4 05:30:42 2022] POST /compute/v2.1/servers/8558ff08-5004-4dc4-892d-5b6610ce6bec/action => generated 0 bytes in 539 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 05:30:43.424752 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-366465f5-086d-454d-9eac-ea7deafe74b9 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:30:43.425257 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-366465f5-086d-454d-9eac-ea7deafe74b9 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] [instance: 8558ff08-5004-4dc4-892d-5b6610ce6bec] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:30:43.434418 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-366465f5-086d-454d-9eac-ea7deafe74b9 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:30:43.435370 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-366465f5-086d-454d-9eac-ea7deafe74b9 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:30:43.436846 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-366465f5-086d-454d-9eac-ea7deafe74b9 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:30:43.437665 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-366465f5-086d-454d-9eac-ea7deafe74b9 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:30:43.663832 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-711bb008-0592-44c1-b82c-16f75b341457 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:30:43.665025 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-711bb008-0592-44c1-b82c-16f75b341457 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] [instance: b45583dc-f18b-4b4a-98e3-ef1bdcf41f80] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:30:43.674943 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-711bb008-0592-44c1-b82c-16f75b341457 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:30:43.679711 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-711bb008-0592-44c1-b82c-16f75b341457 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:30:43.679711 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-711bb008-0592-44c1-b82c-16f75b341457 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:30:43.679711 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-711bb008-0592-44c1-b82c-16f75b341457 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:30:43.749485 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-366465f5-086d-454d-9eac-ea7deafe74b9 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965cf2aad5bc4def9fca55aac87cc37e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32569df1dca45cebcdd63d03ff5abae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:30:43.758714 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-366465f5-086d-454d-9eac-ea7deafe74b9 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] 10.222.0.46 "GET /compute/v2.1/servers/8558ff08-5004-4dc4-892d-5b6610ce6bec" status: 200 len: 1578 microversion: 2.1 time: 0.341923 Aug 04 05:30:43.764573 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 304/607] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:30:43 2022] GET /compute/v2.1/servers/8558ff08-5004-4dc4-892d-5b6610ce6bec => generated 1578 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:30:43.830942 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-711bb008-0592-44c1-b82c-16f75b341457 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb49b631c234f9a9fd47049b9b2e097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faead990837d43de8ec54bfaf24361de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:30:43.864803 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-711bb008-0592-44c1-b82c-16f75b341457 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] 10.222.0.46 "GET /compute/v2.1/servers/b45583dc-f18b-4b4a-98e3-ef1bdcf41f80" status: 200 len: 1613 microversion: 2.1 time: 0.207167 Aug 04 05:30:43.872564 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 304/608] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:30:43 2022] GET /compute/v2.1/servers/b45583dc-f18b-4b4a-98e3-ef1bdcf41f80 => generated 1613 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:30:43.887287 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-2fa151f5-245a-465c-9192-c8b56133a693 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:30:43.888312 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-2fa151f5-245a-465c-9192-c8b56133a693 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] [instance: 9333850c-071c-4330-98b9-84232a752ffe] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:30:43.897867 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-2fa151f5-245a-465c-9192-c8b56133a693 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:30:43.905682 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-2fa151f5-245a-465c-9192-c8b56133a693 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:30:43.905682 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-2fa151f5-245a-465c-9192-c8b56133a693 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:30:43.905682 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-2fa151f5-245a-465c-9192-c8b56133a693 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:30:43.924501 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-33418170-78ee-4f11-901b-d829da9f69d0 tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:30:43.925446 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-33418170-78ee-4f11-901b-d829da9f69d0 tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] [instance: 4edbad4c-dfb3-43c9-992d-f2b2b4744d94] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:30:43.940623 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-2fa151f5-245a-465c-9192-c8b56133a693 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:30:43.941064 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-2fa151f5-245a-465c-9192-c8b56133a693 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:30:43.941519 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.objects.instance [None req-2fa151f5-245a-465c-9192-c8b56133a693 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lazy-loading 'fault' on Instance uuid 9333850c-071c-4330-98b9-84232a752ffe {{(pid=118477) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 05:30:43.942293 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-33418170-78ee-4f11-901b-d829da9f69d0 tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:30:43.943032 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-33418170-78ee-4f11-901b-d829da9f69d0 tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:30:43.946200 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-33418170-78ee-4f11-901b-d829da9f69d0 tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:30:43.948990 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-33418170-78ee-4f11-901b-d829da9f69d0 tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:30:43.985847 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG dbcounter [-] [118476] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=118476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:30:44.046645 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-33418170-78ee-4f11-901b-d829da9f69d0 tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:30:44.055448 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-33418170-78ee-4f11-901b-d829da9f69d0 tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:30:44.055448 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.objects.instance [None req-33418170-78ee-4f11-901b-d829da9f69d0 tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] Lazy-loading 'fault' on Instance uuid 4edbad4c-dfb3-43c9-992d-f2b2b4744d94 {{(pid=118476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 05:30:44.229536 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-2fa151f5-245a-465c-9192-c8b56133a693 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb4dea95659c473b9b193c6234186430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1ca4b83dc874bda9f33e06f4910608c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:30:44.246473 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-2fa151f5-245a-465c-9192-c8b56133a693 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] 10.222.0.46 "GET /compute/v2.1/servers/9333850c-071c-4330-98b9-84232a752ffe" status: 200 len: 1328 microversion: 2.1 time: 0.366709 Aug 04 05:30:44.248178 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 305/609] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:30:43 2022] GET /compute/v2.1/servers/9333850c-071c-4330-98b9-84232a752ffe => generated 1328 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:30:44.254470 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-5f8cba48-15fc-41e5-9006-e19e7d9bd4ba tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:30:44.254470 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-5f8cba48-15fc-41e5-9006-e19e7d9bd4ba tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] [instance: b1a612df-55d1-4106-951d-7f0ea95cfe83] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:30:44.264518 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-33418170-78ee-4f11-901b-d829da9f69d0 tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5af2248451d3483d9742887d614a5077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520d3d5e2e804be1bd5dc9bfc50c5de8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:30:44.274289 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-5f8cba48-15fc-41e5-9006-e19e7d9bd4ba tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:30:44.277480 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-5f8cba48-15fc-41e5-9006-e19e7d9bd4ba tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:30:44.277480 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-5f8cba48-15fc-41e5-9006-e19e7d9bd4ba tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:30:44.277480 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-5f8cba48-15fc-41e5-9006-e19e7d9bd4ba tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:30:44.282070 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-33418170-78ee-4f11-901b-d829da9f69d0 tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] 10.222.0.46 "GET /compute/v2.1/servers/4edbad4c-dfb3-43c9-992d-f2b2b4744d94" status: 200 len: 1309 microversion: 2.1 time: 0.361750 Aug 04 05:30:44.283735 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 305/610] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:30:43 2022] GET /compute/v2.1/servers/4edbad4c-dfb3-43c9-992d-f2b2b4744d94 => generated 1309 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 05:30:44.327761 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.wsgi [None req-5f8cba48-15fc-41e5-9006-e19e7d9bd4ba tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] HTTP exception thrown: Instance b1a612df-55d1-4106-951d-7f0ea95cfe83 could not be found. Aug 04 05:30:44.331367 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-5f8cba48-15fc-41e5-9006-e19e7d9bd4ba tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Request method failure captured: Aug 04 05:30:44.331367 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: request: GET /compute/v2.1/servers/b1a612df-55d1-4106-951d-7f0ea95cfe83 HTTP/1.1 Aug 04 05:30:44.331367 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: Accept: application/json Aug 04 05:30:44.331367 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: Accept-Encoding: identity Aug 04 05:30:44.331367 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: Connection: close Aug 04 05:30:44.331367 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: Content-Length: 0 Aug 04 05:30:44.331367 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: Content-Type: application/json Aug 04 05:30:44.331367 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: Host: 10.222.0.46 Aug 04 05:30:44.331367 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: Openstack-System-Scope: None Aug 04 05:30:44.331367 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: User-Agent: python-urllib3/1.26.11 Aug 04 05:30:44.331367 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Auth-Token: gAAAAABi61g53OabLgO4gW69xhev3-hVAHcOcUE9Y2w5YBGtgFfk0SOjtoLwecmlrXgTD_O28rN04Wx-xl4rDlr6cEau3Mp5S6ihh8QrLzUUzoS_WNUMRZYqOqiUmHYH7qSat4VCjMgYwUWTzg9zUzn68Xb9K2m9ofVkhx1oUsZEWZ2JuoREn50 Aug 04 05:30:44.331367 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Domain-Id: None Aug 04 05:30:44.331367 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Domain-Name: None Aug 04 05:30:44.331367 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Identity-Status: Confirmed Aug 04 05:30:44.331367 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Is-Admin-Project: True Aug 04 05:30:44.331367 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Project-Domain-Id: default Aug 04 05:30:44.331367 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Project-Domain-Name: Default Aug 04 05:30:44.331367 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Project-Id: b62d19c831574f9b99c993b5e41c645d Aug 04 05:30:44.331367 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1543928594 Aug 04 05:30:44.331367 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Role: member,reader Aug 04 05:30:44.331367 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Roles: member,reader Aug 04 05:30:44.339401 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/b62d19c831574f9b99c993b5e41c645d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/b62d19c831574f9b99c993b5e41c645d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_b62d19c831574f9b99c993b5e41c645d", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/b62d19c831574f9b99c993b5e41c645d"}]}] Aug 04 05:30:44.339401 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1543928594 Aug 04 05:30:44.339401 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Tenant-Id: b62d19c831574f9b99c993b5e41c645d Aug 04 05:30:44.339401 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1543928594 Aug 04 05:30:44.339401 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-User: tempest-ServerRescueNegativeTestJSON-1543928594-project Aug 04 05:30:44.339401 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-User-Domain-Id: default Aug 04 05:30:44.339401 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-User-Domain-Name: Default Aug 04 05:30:44.339401 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-User-Id: ab8f887f5689419e9e31a0ba43f76ada Aug 04 05:30:44.339401 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1543928594-project Aug 04 05:30:44.339401 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: method: > Aug 04 05:30:44.339401 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: exception: Instance b1a612df-55d1-4106-951d-7f0ea95cfe83 could not be found. Aug 04 05:30:44.339401 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: action_args: {'id': 'b1a612df-55d1-4106-951d-7f0ea95cfe83'} Aug 04 05:30:44.340300 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 05:30:44.340300 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:30:44.340300 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 05:30:44.340300 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 05:30:44.340300 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 05:30:44.340300 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 05:30:44.340300 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 05:30:44.340300 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 05:30:44.340300 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 05:30:44.340300 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 05:30:44.340300 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b1a612df-55d1-4106-951d-7f0ea95cfe83 could not be found. Aug 04 05:30:44.340300 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Aug 04 05:30:44.340300 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:30:44.340300 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Aug 04 05:30:44.340300 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:30:44.340300 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:30:44.340300 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:30:44.340300 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 05:30:44.340300 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 05:30:44.340300 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 05:30:44.341796 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 05:30:44.341796 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 05:30:44.341796 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 05:30:44.341796 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 05:30:44.341796 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 05:30:44.341796 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 05:30:44.341796 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 05:30:44.341796 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b1a612df-55d1-4106-951d-7f0ea95cfe83 could not be found. Aug 04 05:30:44.341796 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Aug 04 05:30:44.341796 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:30:44.341796 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Aug 04 05:30:44.341796 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:30:44.341796 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:30:44.341796 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:30:44.341796 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 05:30:44.341796 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 05:30:44.341796 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b1a612df-55d1-4106-951d-7f0ea95cfe83 could not be found. Aug 04 05:30:44.341796 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Aug 04 05:30:44.343109 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-5f8cba48-15fc-41e5-9006-e19e7d9bd4ba tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] Returning 404 to user: Instance b1a612df-55d1-4106-951d-7f0ea95cfe83 could not be found. {{(pid=118477) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 05:30:44.343109 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-5f8cba48-15fc-41e5-9006-e19e7d9bd4ba tempest-ServerRescueNegativeTestJSON-1543928594 tempest-ServerRescueNegativeTestJSON-1543928594-project] 10.222.0.46 "GET /compute/v2.1/servers/b1a612df-55d1-4106-951d-7f0ea95cfe83" status: 404 len: 111 microversion: 2.1 time: 0.085260 Aug 04 05:30:44.343109 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 306/611] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:30:44 2022] GET /compute/v2.1/servers/b1a612df-55d1-4106-951d-7f0ea95cfe83 => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 05:30:44.788230 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-e9a031f8-a43d-43eb-933b-e61a906a7f47 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:30:44.800068 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-e9a031f8-a43d-43eb-933b-e61a906a7f47 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] [instance: 8558ff08-5004-4dc4-892d-5b6610ce6bec] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:30:44.800068 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-e9a031f8-a43d-43eb-933b-e61a906a7f47 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:30:44.800068 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-e9a031f8-a43d-43eb-933b-e61a906a7f47 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:30:44.802629 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-e9a031f8-a43d-43eb-933b-e61a906a7f47 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:30:44.804920 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-e9a031f8-a43d-43eb-933b-e61a906a7f47 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:30:44.896036 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-c082de5e-219b-4b1a-8545-2d2b6e4a5176 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:30:44.898622 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-c082de5e-219b-4b1a-8545-2d2b6e4a5176 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] [instance: b45583dc-f18b-4b4a-98e3-ef1bdcf41f80] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:30:44.941969 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-c082de5e-219b-4b1a-8545-2d2b6e4a5176 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:30:44.950186 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-c082de5e-219b-4b1a-8545-2d2b6e4a5176 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:30:44.957530 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-c082de5e-219b-4b1a-8545-2d2b6e4a5176 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:30:44.957530 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-c082de5e-219b-4b1a-8545-2d2b6e4a5176 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:30:45.049964 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-c082de5e-219b-4b1a-8545-2d2b6e4a5176 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:30:45.050096 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-c082de5e-219b-4b1a-8545-2d2b6e4a5176 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:30:45.051173 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.objects.instance [None req-c082de5e-219b-4b1a-8545-2d2b6e4a5176 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lazy-loading 'fault' on Instance uuid b45583dc-f18b-4b4a-98e3-ef1bdcf41f80 {{(pid=118477) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 05:30:45.157610 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-c082de5e-219b-4b1a-8545-2d2b6e4a5176 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb49b631c234f9a9fd47049b9b2e097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faead990837d43de8ec54bfaf24361de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:30:45.174888 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-c082de5e-219b-4b1a-8545-2d2b6e4a5176 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] 10.222.0.46 "GET /compute/v2.1/servers/b45583dc-f18b-4b4a-98e3-ef1bdcf41f80" status: 200 len: 1329 microversion: 2.1 time: 0.278248 Aug 04 05:30:45.175534 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-e9a031f8-a43d-43eb-933b-e61a906a7f47 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965cf2aad5bc4def9fca55aac87cc37e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32569df1dca45cebcdd63d03ff5abae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:30:45.175652 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 307/612] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:30:44 2022] GET /compute/v2.1/servers/b45583dc-f18b-4b4a-98e3-ef1bdcf41f80 => generated 1329 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:30:45.183894 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-e9a031f8-a43d-43eb-933b-e61a906a7f47 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] 10.222.0.46 "GET /compute/v2.1/servers/8558ff08-5004-4dc4-892d-5b6610ce6bec" status: 200 len: 1518 microversion: 2.1 time: 0.402263 Aug 04 05:30:45.185199 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 306/613] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:30:44 2022] GET /compute/v2.1/servers/8558ff08-5004-4dc4-892d-5b6610ce6bec => generated 1518 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:30:45.200505 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [req-e2850ffd-64a2-4a7b-905c-e0ab3a0bd13d req-381833aa-5edb-4be5-8346-ca5e4284602f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b45583dc-f18b-4b4a-98e3-ef1bdcf41f80", "name": "network-vif-deleted", "tag": "a18f6abd-9021-4bcf-bf94-d461caa21de9"}]} {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:30:45.211920 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [req-e2850ffd-64a2-4a7b-905c-e0ab3a0bd13d req-381833aa-5edb-4be5-8346-ca5e4284602f service nova] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:30:45.212541 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [req-e2850ffd-64a2-4a7b-905c-e0ab3a0bd13d req-381833aa-5edb-4be5-8346-ca5e4284602f service nova] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:30:45.228765 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.compute.server_external_events [req-e2850ffd-64a2-4a7b-905c-e0ab3a0bd13d req-381833aa-5edb-4be5-8346-ca5e4284602f service nova] Creating event network-vif-deleted:a18f6abd-9021-4bcf-bf94-d461caa21de9 for instance b45583dc-f18b-4b4a-98e3-ef1bdcf41f80 on hv-cinder-85207 Aug 04 05:30:45.235028 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [req-e2850ffd-64a2-4a7b-905c-e0ab3a0bd13d req-381833aa-5edb-4be5-8346-ca5e4284602f service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059415 Aug 04 05:30:45.236211 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 308/614] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Aug 4 05:30:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:30:45.275283 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-197a3a01-d5c7-426a-8bb7-7b88a42a44fc tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:30:45.276159 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-197a3a01-d5c7-426a-8bb7-7b88a42a44fc tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] [instance: 9333850c-071c-4330-98b9-84232a752ffe] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:30:45.293701 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-197a3a01-d5c7-426a-8bb7-7b88a42a44fc tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:30:45.295128 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-197a3a01-d5c7-426a-8bb7-7b88a42a44fc tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:30:45.296751 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-197a3a01-d5c7-426a-8bb7-7b88a42a44fc tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:30:45.297690 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-197a3a01-d5c7-426a-8bb7-7b88a42a44fc tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:30:45.306672 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-fb16c956-4e1f-4d2d-a673-829aa0ea9b56 tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:30:45.307384 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-fb16c956-4e1f-4d2d-a673-829aa0ea9b56 tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] [instance: 4edbad4c-dfb3-43c9-992d-f2b2b4744d94] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:30:45.317776 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.wsgi [None req-197a3a01-d5c7-426a-8bb7-7b88a42a44fc tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] HTTP exception thrown: Instance 9333850c-071c-4330-98b9-84232a752ffe could not be found. Aug 04 05:30:45.322403 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-197a3a01-d5c7-426a-8bb7-7b88a42a44fc tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Request method failure captured: Aug 04 05:30:45.322403 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: request: GET /compute/v2.1/servers/9333850c-071c-4330-98b9-84232a752ffe HTTP/1.1 Aug 04 05:30:45.322403 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: Accept: application/json Aug 04 05:30:45.322403 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: Accept-Encoding: identity Aug 04 05:30:45.322403 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: Connection: close Aug 04 05:30:45.322403 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: Content-Length: 0 Aug 04 05:30:45.322403 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: Content-Type: application/json Aug 04 05:30:45.322403 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: Host: 10.222.0.46 Aug 04 05:30:45.322403 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: Openstack-System-Scope: None Aug 04 05:30:45.322403 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: User-Agent: python-urllib3/1.26.11 Aug 04 05:30:45.322403 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Auth-Token: gAAAAABi61ibB27zcAqkTFBz3ZHZQBTyYLUiz1L71kTAJ1mIgw23NzfP3be8JfDUo2j8H621Gq4ZtR6Qkl_uc57pKHyYmWoyApQ0u1rcdhH843jVllSfSpyjvEna5qAHPkZneB2RW8yXCDwaidRZA-fexzYeio0C9gcFg53_Z47USjhBWgHa8uc Aug 04 05:30:45.322403 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Domain-Id: None Aug 04 05:30:45.322403 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Domain-Name: None Aug 04 05:30:45.322403 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Identity-Status: Confirmed Aug 04 05:30:45.322403 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Is-Admin-Project: True Aug 04 05:30:45.322403 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Project-Domain-Id: default Aug 04 05:30:45.322403 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Project-Domain-Name: Default Aug 04 05:30:45.322403 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Project-Id: d1ca4b83dc874bda9f33e06f4910608c Aug 04 05:30:45.322403 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Project-Name: tempest-AttachVolumeTestJSON-785443369 Aug 04 05:30:45.322403 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Role: member,reader Aug 04 05:30:45.322403 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Roles: member,reader Aug 04 05:30:45.323663 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/d1ca4b83dc874bda9f33e06f4910608c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/d1ca4b83dc874bda9f33e06f4910608c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_d1ca4b83dc874bda9f33e06f4910608c", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/d1ca4b83dc874bda9f33e06f4910608c"}]}] Aug 04 05:30:45.323663 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Tenant: tempest-AttachVolumeTestJSON-785443369 Aug 04 05:30:45.323663 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Tenant-Id: d1ca4b83dc874bda9f33e06f4910608c Aug 04 05:30:45.323663 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Tenant-Name: tempest-AttachVolumeTestJSON-785443369 Aug 04 05:30:45.323663 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-User: tempest-AttachVolumeTestJSON-785443369-project Aug 04 05:30:45.323663 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-User-Domain-Id: default Aug 04 05:30:45.323663 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-User-Domain-Name: Default Aug 04 05:30:45.323663 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-User-Id: eb4dea95659c473b9b193c6234186430 Aug 04 05:30:45.323663 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-User-Name: tempest-AttachVolumeTestJSON-785443369-project Aug 04 05:30:45.323663 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: method: > Aug 04 05:30:45.323663 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: exception: Instance 9333850c-071c-4330-98b9-84232a752ffe could not be found. Aug 04 05:30:45.323663 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: action_args: {'id': '9333850c-071c-4330-98b9-84232a752ffe'} Aug 04 05:30:45.324416 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 05:30:45.324416 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:30:45.324416 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 05:30:45.324416 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 05:30:45.324416 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 05:30:45.324416 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 05:30:45.324416 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 05:30:45.324416 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 05:30:45.324416 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 05:30:45.324416 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 05:30:45.324416 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9333850c-071c-4330-98b9-84232a752ffe could not be found. Aug 04 05:30:45.324416 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Aug 04 05:30:45.324416 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:30:45.324416 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Aug 04 05:30:45.324416 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:30:45.324416 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:30:45.324416 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:30:45.324416 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 05:30:45.324416 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 05:30:45.324416 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 05:30:45.325784 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 05:30:45.325784 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 05:30:45.325784 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 05:30:45.325784 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 05:30:45.325784 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 05:30:45.325784 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 05:30:45.325784 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 05:30:45.325784 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9333850c-071c-4330-98b9-84232a752ffe could not be found. Aug 04 05:30:45.325784 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Aug 04 05:30:45.325784 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:30:45.325784 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Aug 04 05:30:45.325784 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:30:45.325784 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:30:45.325784 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:30:45.325784 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 05:30:45.325784 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 05:30:45.325784 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9333850c-071c-4330-98b9-84232a752ffe could not be found. Aug 04 05:30:45.325784 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Aug 04 05:30:45.326894 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-197a3a01-d5c7-426a-8bb7-7b88a42a44fc tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Returning 404 to user: Instance 9333850c-071c-4330-98b9-84232a752ffe could not be found. {{(pid=118476) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 05:30:45.326894 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-197a3a01-d5c7-426a-8bb7-7b88a42a44fc tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] 10.222.0.46 "GET /compute/v2.1/servers/9333850c-071c-4330-98b9-84232a752ffe" status: 404 len: 111 microversion: 2.1 time: 0.052083 Aug 04 05:30:45.328279 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 307/615] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:30:45 2022] GET /compute/v2.1/servers/9333850c-071c-4330-98b9-84232a752ffe => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 05:30:45.329933 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-fb16c956-4e1f-4d2d-a673-829aa0ea9b56 tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:30:45.330861 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-fb16c956-4e1f-4d2d-a673-829aa0ea9b56 tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:30:45.334208 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-09495462-23d4-4890-9b2f-d88293ea8f82 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Calling method '.version_select at 0x7f14754930d0>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:30:45.336710 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-fb16c956-4e1f-4d2d-a673-829aa0ea9b56 tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:30:45.338853 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-fb16c956-4e1f-4d2d-a673-829aa0ea9b56 tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:30:45.373185 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.wsgi [None req-fb16c956-4e1f-4d2d-a673-829aa0ea9b56 tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] HTTP exception thrown: Instance 4edbad4c-dfb3-43c9-992d-f2b2b4744d94 could not be found. Aug 04 05:30:45.380143 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-fb16c956-4e1f-4d2d-a673-829aa0ea9b56 tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] Request method failure captured: Aug 04 05:30:45.380143 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: request: GET /compute/v2.1/servers/4edbad4c-dfb3-43c9-992d-f2b2b4744d94 HTTP/1.1 Aug 04 05:30:45.380143 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: Accept: application/json Aug 04 05:30:45.380143 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: Accept-Encoding: identity Aug 04 05:30:45.380143 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: Connection: close Aug 04 05:30:45.380143 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: Content-Length: 0 Aug 04 05:30:45.380143 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: Content-Type: application/json Aug 04 05:30:45.380143 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: Host: 10.222.0.46 Aug 04 05:30:45.380143 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: Openstack-System-Scope: None Aug 04 05:30:45.380143 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: User-Agent: python-urllib3/1.26.11 Aug 04 05:30:45.380143 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Auth-Token: gAAAAABi61kwTX1Bb2w2An8VY9IljT4THIT-q7oVrnWc7W7ZproVrLJcBk5oSKC-OsORA_k8sFoSueYgwtrqKLzUwkO-Fl0n412JPjyX6XOSFapSKcFz4pNB66KI3dbrYI0tHu3RdlIqAZjBcv3tcpUS_68tq0nnERibEUA5uOdEeGv-Pbw1c00 Aug 04 05:30:45.380143 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Domain-Id: None Aug 04 05:30:45.380143 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Domain-Name: None Aug 04 05:30:45.380143 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Identity-Status: Confirmed Aug 04 05:30:45.380143 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Is-Admin-Project: True Aug 04 05:30:45.380143 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Project-Domain-Id: default Aug 04 05:30:45.380143 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Project-Domain-Name: Default Aug 04 05:30:45.380143 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Project-Id: 520d3d5e2e804be1bd5dc9bfc50c5de8 Aug 04 05:30:45.380143 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Project-Name: tempest-VolumesSnapshotTestJSON-835247731 Aug 04 05:30:45.380143 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Role: member,reader Aug 04 05:30:45.380143 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Roles: member,reader Aug 04 05:30:45.381414 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/520d3d5e2e804be1bd5dc9bfc50c5de8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/520d3d5e2e804be1bd5dc9bfc50c5de8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_520d3d5e2e804be1bd5dc9bfc50c5de8", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/520d3d5e2e804be1bd5dc9bfc50c5de8"}]}] Aug 04 05:30:45.381414 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Tenant: tempest-VolumesSnapshotTestJSON-835247731 Aug 04 05:30:45.381414 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Tenant-Id: 520d3d5e2e804be1bd5dc9bfc50c5de8 Aug 04 05:30:45.381414 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-835247731 Aug 04 05:30:45.381414 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-User: tempest-VolumesSnapshotTestJSON-835247731-project Aug 04 05:30:45.381414 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-User-Domain-Id: default Aug 04 05:30:45.381414 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-User-Domain-Name: Default Aug 04 05:30:45.381414 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-User-Id: 5af2248451d3483d9742887d614a5077 Aug 04 05:30:45.381414 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-User-Name: tempest-VolumesSnapshotTestJSON-835247731-project Aug 04 05:30:45.381414 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: method: > Aug 04 05:30:45.381414 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: exception: Instance 4edbad4c-dfb3-43c9-992d-f2b2b4744d94 could not be found. Aug 04 05:30:45.381414 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: action_args: {'id': '4edbad4c-dfb3-43c9-992d-f2b2b4744d94'} Aug 04 05:30:45.382219 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 05:30:45.382219 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:30:45.382219 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 05:30:45.382219 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 05:30:45.382219 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 05:30:45.382219 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 05:30:45.382219 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 05:30:45.382219 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 05:30:45.382219 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 05:30:45.382219 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 05:30:45.382219 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4edbad4c-dfb3-43c9-992d-f2b2b4744d94 could not be found. Aug 04 05:30:45.382219 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Aug 04 05:30:45.382219 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:30:45.382219 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Aug 04 05:30:45.382219 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:30:45.382219 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:30:45.382219 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:30:45.382219 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 05:30:45.382219 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 05:30:45.382219 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 05:30:45.383421 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 05:30:45.383421 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 05:30:45.383421 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 05:30:45.383421 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 05:30:45.383421 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 05:30:45.383421 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 05:30:45.383421 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 05:30:45.383421 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4edbad4c-dfb3-43c9-992d-f2b2b4744d94 could not be found. Aug 04 05:30:45.383421 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Aug 04 05:30:45.383421 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:30:45.383421 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Aug 04 05:30:45.383421 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:30:45.383421 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:30:45.383421 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:30:45.383421 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 05:30:45.383421 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 05:30:45.383421 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4edbad4c-dfb3-43c9-992d-f2b2b4744d94 could not be found. Aug 04 05:30:45.383421 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Aug 04 05:30:45.384457 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-fb16c956-4e1f-4d2d-a673-829aa0ea9b56 tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] Returning 404 to user: Instance 4edbad4c-dfb3-43c9-992d-f2b2b4744d94 could not be found. {{(pid=118477) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 05:30:45.384457 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-fb16c956-4e1f-4d2d-a673-829aa0ea9b56 tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] 10.222.0.46 "GET /compute/v2.1/servers/4edbad4c-dfb3-43c9-992d-f2b2b4744d94" status: 404 len: 111 microversion: 2.1 time: 0.078606 Aug 04 05:30:45.384457 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 309/616] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:30:45 2022] GET /compute/v2.1/servers/4edbad4c-dfb3-43c9-992d-f2b2b4744d94 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 04 05:30:45.430820 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-09495462-23d4-4890-9b2f-d88293ea8f82 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1378104158" status: 202 len: 0 microversion: 2.1 time: 0.100515 Aug 04 05:30:45.431445 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 308/617] 10.222.0.46 () {58 vars in 1221 bytes} [Thu Aug 4 05:30:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1378104158 => generated 0 bytes in 102 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 05:30:46.208159 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-2c6e9ce2-32f4-4921-8169-b6b8656ccd45 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:30:46.208805 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-2c6e9ce2-32f4-4921-8169-b6b8656ccd45 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] [instance: 8558ff08-5004-4dc4-892d-5b6610ce6bec] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:30:46.214794 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-aff442e7-5978-41cf-804d-9a6e0ef601c6 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:30:46.216254 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-aff442e7-5978-41cf-804d-9a6e0ef601c6 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] [instance: b45583dc-f18b-4b4a-98e3-ef1bdcf41f80] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:30:46.231633 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-aff442e7-5978-41cf-804d-9a6e0ef601c6 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:30:46.232087 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-aff442e7-5978-41cf-804d-9a6e0ef601c6 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:30:46.233083 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-aff442e7-5978-41cf-804d-9a6e0ef601c6 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:30:46.233516 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-aff442e7-5978-41cf-804d-9a6e0ef601c6 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:30:46.236986 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-2c6e9ce2-32f4-4921-8169-b6b8656ccd45 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:30:46.237624 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-2c6e9ce2-32f4-4921-8169-b6b8656ccd45 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:30:46.239718 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-2c6e9ce2-32f4-4921-8169-b6b8656ccd45 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:30:46.241332 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-2c6e9ce2-32f4-4921-8169-b6b8656ccd45 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:30:46.271522 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.wsgi [None req-aff442e7-5978-41cf-804d-9a6e0ef601c6 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] HTTP exception thrown: Instance b45583dc-f18b-4b4a-98e3-ef1bdcf41f80 could not be found. Aug 04 05:30:46.274330 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-aff442e7-5978-41cf-804d-9a6e0ef601c6 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Request method failure captured: Aug 04 05:30:46.274330 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: request: GET /compute/v2.1/servers/b45583dc-f18b-4b4a-98e3-ef1bdcf41f80 HTTP/1.1 Aug 04 05:30:46.274330 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: Accept: application/json Aug 04 05:30:46.274330 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: Accept-Encoding: identity Aug 04 05:30:46.274330 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: Connection: close Aug 04 05:30:46.274330 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: Content-Length: 0 Aug 04 05:30:46.274330 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: Content-Type: application/json Aug 04 05:30:46.274330 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: Host: 10.222.0.46 Aug 04 05:30:46.274330 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: Openstack-System-Scope: None Aug 04 05:30:46.274330 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: User-Agent: python-urllib3/1.26.11 Aug 04 05:30:46.274330 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Auth-Token: gAAAAABi61g0x_8sFigG1jfXTOdqOMY1_3lK7UxaN3VmL5lqQXtIkCz4pWJYdYey2zGuiTigaV5gr0UWhaKZvxst4Kz-KOaAO64aM30ubWqVQfLIrJqf-RP6LF-c0ZabM-LUcJmxEmCuhHsUTEzNbVJn1WT0ja1hpuQC9pVY6l0Uzp1TYNzYyh0 Aug 04 05:30:46.274330 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Domain-Id: None Aug 04 05:30:46.274330 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Domain-Name: None Aug 04 05:30:46.274330 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Identity-Status: Confirmed Aug 04 05:30:46.274330 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Is-Admin-Project: True Aug 04 05:30:46.274330 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Project-Domain-Id: default Aug 04 05:30:46.274330 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Project-Domain-Name: Default Aug 04 05:30:46.274330 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Project-Id: faead990837d43de8ec54bfaf24361de Aug 04 05:30:46.274330 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Project-Name: tempest-AttachVolumeNegativeTest-710656709 Aug 04 05:30:46.274330 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Role: member,reader Aug 04 05:30:46.274330 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Roles: member,reader Aug 04 05:30:46.281989 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/faead990837d43de8ec54bfaf24361de"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/faead990837d43de8ec54bfaf24361de"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_faead990837d43de8ec54bfaf24361de", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/faead990837d43de8ec54bfaf24361de"}]}] Aug 04 05:30:46.281989 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Tenant: tempest-AttachVolumeNegativeTest-710656709 Aug 04 05:30:46.281989 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Tenant-Id: faead990837d43de8ec54bfaf24361de Aug 04 05:30:46.281989 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-710656709 Aug 04 05:30:46.281989 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-User: tempest-AttachVolumeNegativeTest-710656709-project Aug 04 05:30:46.281989 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-User-Domain-Id: default Aug 04 05:30:46.281989 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-User-Domain-Name: Default Aug 04 05:30:46.281989 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-User-Id: 9cb49b631c234f9a9fd47049b9b2e097 Aug 04 05:30:46.281989 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-User-Name: tempest-AttachVolumeNegativeTest-710656709-project Aug 04 05:30:46.281989 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: method: > Aug 04 05:30:46.281989 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: exception: Instance b45583dc-f18b-4b4a-98e3-ef1bdcf41f80 could not be found. Aug 04 05:30:46.281989 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: action_args: {'id': 'b45583dc-f18b-4b4a-98e3-ef1bdcf41f80'} Aug 04 05:30:46.282796 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 05:30:46.282796 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:30:46.282796 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 05:30:46.282796 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 05:30:46.282796 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 05:30:46.282796 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 05:30:46.282796 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 05:30:46.282796 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 05:30:46.282796 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 05:30:46.282796 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 05:30:46.282796 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b45583dc-f18b-4b4a-98e3-ef1bdcf41f80 could not be found. Aug 04 05:30:46.282796 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Aug 04 05:30:46.282796 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:30:46.282796 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Aug 04 05:30:46.282796 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:30:46.282796 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:30:46.282796 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:30:46.282796 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 05:30:46.282796 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 05:30:46.282796 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 05:30:46.283950 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 05:30:46.283950 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 05:30:46.283950 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 05:30:46.283950 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 05:30:46.283950 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 05:30:46.283950 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 05:30:46.283950 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 05:30:46.283950 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b45583dc-f18b-4b4a-98e3-ef1bdcf41f80 could not be found. Aug 04 05:30:46.283950 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Aug 04 05:30:46.283950 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:30:46.283950 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Aug 04 05:30:46.283950 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:30:46.283950 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:30:46.283950 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:30:46.283950 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 05:30:46.283950 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 05:30:46.283950 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b45583dc-f18b-4b4a-98e3-ef1bdcf41f80 could not be found. Aug 04 05:30:46.283950 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Aug 04 05:30:46.285954 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-aff442e7-5978-41cf-804d-9a6e0ef601c6 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Returning 404 to user: Instance b45583dc-f18b-4b4a-98e3-ef1bdcf41f80 could not be found. {{(pid=118477) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 05:30:46.285954 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-aff442e7-5978-41cf-804d-9a6e0ef601c6 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] 10.222.0.46 "GET /compute/v2.1/servers/b45583dc-f18b-4b4a-98e3-ef1bdcf41f80" status: 404 len: 111 microversion: 2.1 time: 0.085365 Aug 04 05:30:46.285954 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 310/618] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:30:46 2022] GET /compute/v2.1/servers/b45583dc-f18b-4b4a-98e3-ef1bdcf41f80 => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 05:30:46.292150 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-bd4bd71a-e87a-4bfd-b065-06f7e7550590 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Calling method '.version_select at 0x7f1475599670>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:30:46.426221 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-bd4bd71a-e87a-4bfd-b065-06f7e7550590 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2077896344" status: 202 len: 0 microversion: 2.1 time: 0.140615 Aug 04 05:30:46.426831 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 311/619] 10.222.0.46 () {58 vars in 1221 bytes} [Thu Aug 4 05:30:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2077896344 => generated 0 bytes in 142 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 05:30:46.574302 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-2c6e9ce2-32f4-4921-8169-b6b8656ccd45 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965cf2aad5bc4def9fca55aac87cc37e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32569df1dca45cebcdd63d03ff5abae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:30:46.595302 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-2c6e9ce2-32f4-4921-8169-b6b8656ccd45 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] 10.222.0.46 "GET /compute/v2.1/servers/8558ff08-5004-4dc4-892d-5b6610ce6bec" status: 200 len: 1520 microversion: 2.1 time: 0.391463 Aug 04 05:30:46.598642 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 309/620] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:30:46 2022] GET /compute/v2.1/servers/8558ff08-5004-4dc4-892d-5b6610ce6bec => generated 1520 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 05:30:47.080979 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-9ae1534a-755f-48c8-94a1-671accdd1e83 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Action: 'create', calling method: .version_select at 0x7f1475572550>, body: {"keypair": {"name": "tempest-keypair-1130835071", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEJfKTdFEdEt17H1ETDynhdkjvFkDeXnM2L3bBWoP7w+KTwiSEfytX0SlXV6r2Ue2W2MhX+4qfyUMVGYWYHZzN0yEXDION6auUOg5USlvZUSv7S35pCceQasysd2MKTWqA=="}} {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:30:47.121860 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.quota [None req-9ae1534a-755f-48c8-94a1-671accdd1e83 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Getting quotas for project d1ca4b83dc874bda9f33e06f4910608c. Resources: {'key_pairs'} {{(pid=118477) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 05:30:47.129285 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.quota [None req-9ae1534a-755f-48c8-94a1-671accdd1e83 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Getting quotas for user eb4dea95659c473b9b193c6234186430 and project d1ca4b83dc874bda9f33e06f4910608c. Resources: {'key_pairs'} {{(pid=118477) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 05:30:47.231249 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-9ae1534a-755f-48c8-94a1-671accdd1e83 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.156536 Aug 04 05:30:47.232651 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 312/621] 10.222.0.46 () {60 vars in 1159 bytes} [Thu Aug 4 05:30:47 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:30:47.620917 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-dd6ee69a-57b6-45d4-aa42-09b913c2537f tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:30:47.622298 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-dd6ee69a-57b6-45d4-aa42-09b913c2537f tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] [instance: 8558ff08-5004-4dc4-892d-5b6610ce6bec] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:30:47.681773 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-dd6ee69a-57b6-45d4-aa42-09b913c2537f tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:30:47.681773 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-dd6ee69a-57b6-45d4-aa42-09b913c2537f tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:30:47.681773 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-dd6ee69a-57b6-45d4-aa42-09b913c2537f tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:30:47.681773 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-dd6ee69a-57b6-45d4-aa42-09b913c2537f tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:30:47.810007 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-dd6ee69a-57b6-45d4-aa42-09b913c2537f tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965cf2aad5bc4def9fca55aac87cc37e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32569df1dca45cebcdd63d03ff5abae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:30:47.824872 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-dd6ee69a-57b6-45d4-aa42-09b913c2537f tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] 10.222.0.46 "GET /compute/v2.1/servers/8558ff08-5004-4dc4-892d-5b6610ce6bec" status: 200 len: 1520 microversion: 2.1 time: 0.210018 Aug 04 05:30:47.839263 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 310/622] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:30:47 2022] GET /compute/v2.1/servers/8558ff08-5004-4dc4-892d-5b6610ce6bec => generated 1520 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:30:48.171379 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-df04466c-08fd-419d-aaa2-448b71ed7916 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Action: 'create', calling method: .version_select at 0x7f14754da430>, body: {"keypair": {"name": "tempest-keypair-557213845", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBGE4ogxJyOQVsAFo0hKld5Bqp+PWXbIMyRawavhm+HORDJpVaVuoMkAjlV2Feg5Qvfr44BCjNYP2r+q77KTbs+3DJLEKhE6YJ7dx8xSvdI5ZJx60qWVi0u5sUFxvgyK0A=="}} {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:30:48.193286 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.quota [None req-df04466c-08fd-419d-aaa2-448b71ed7916 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Getting quotas for project faead990837d43de8ec54bfaf24361de. Resources: {'key_pairs'} {{(pid=118477) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 05:30:48.200780 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.quota [None req-df04466c-08fd-419d-aaa2-448b71ed7916 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Getting quotas for user 9cb49b631c234f9a9fd47049b9b2e097 and project faead990837d43de8ec54bfaf24361de. Resources: {'key_pairs'} {{(pid=118477) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 05:30:48.338685 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-df04466c-08fd-419d-aaa2-448b71ed7916 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.173058 Aug 04 05:30:48.339327 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 313/623] 10.222.0.46 () {60 vars in 1159 bytes} [Thu Aug 4 05:30:48 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:30:48.846836 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-69a4c136-60fb-4871-bad9-6179fefcf63f tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:30:48.848194 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-69a4c136-60fb-4871-bad9-6179fefcf63f tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] [instance: 8558ff08-5004-4dc4-892d-5b6610ce6bec] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:30:48.856549 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-69a4c136-60fb-4871-bad9-6179fefcf63f tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:30:48.857399 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-69a4c136-60fb-4871-bad9-6179fefcf63f tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:30:48.858512 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-69a4c136-60fb-4871-bad9-6179fefcf63f tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:30:48.859097 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-69a4c136-60fb-4871-bad9-6179fefcf63f tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:30:49.198221 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-69a4c136-60fb-4871-bad9-6179fefcf63f tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965cf2aad5bc4def9fca55aac87cc37e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32569df1dca45cebcdd63d03ff5abae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:30:49.213048 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-69a4c136-60fb-4871-bad9-6179fefcf63f tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] 10.222.0.46 "GET /compute/v2.1/servers/8558ff08-5004-4dc4-892d-5b6610ce6bec" status: 200 len: 1520 microversion: 2.1 time: 0.370323 Aug 04 05:30:49.224149 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 311/624] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:30:48 2022] GET /compute/v2.1/servers/8558ff08-5004-4dc4-892d-5b6610ce6bec => generated 1520 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:30:50.244894 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-a7272248-0f30-462c-9862-29d254173925 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:30:50.246203 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-a7272248-0f30-462c-9862-29d254173925 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] [instance: 8558ff08-5004-4dc4-892d-5b6610ce6bec] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:30:50.255580 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-a7272248-0f30-462c-9862-29d254173925 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:30:50.256394 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-a7272248-0f30-462c-9862-29d254173925 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:30:50.257680 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-a7272248-0f30-462c-9862-29d254173925 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:30:50.259886 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-a7272248-0f30-462c-9862-29d254173925 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:30:50.680368 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-a7272248-0f30-462c-9862-29d254173925 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965cf2aad5bc4def9fca55aac87cc37e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32569df1dca45cebcdd63d03ff5abae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:30:50.697806 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-a7272248-0f30-462c-9862-29d254173925 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] 10.222.0.46 "GET /compute/v2.1/servers/8558ff08-5004-4dc4-892d-5b6610ce6bec" status: 200 len: 1576 microversion: 2.1 time: 0.461003 Aug 04 05:30:50.699029 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 314/625] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:30:50 2022] GET /compute/v2.1/servers/8558ff08-5004-4dc4-892d-5b6610ce6bec => generated 1576 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:30:51.355804 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-98e6a1ed-d730-450d-9a49-a8f289551073 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-467817346", "imageRef": "4613f7d0-37ca-46ad-bb26-dc4990dd7d6f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "bfbea54a-6e02-4895-9b85-ca7cad74aeed"}], "security_groups": [{"name": "tempest-securitygroup--1284019360"}], "key_name": "tempest-keypair-1130835071", "user_data": "}} {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:30:51.490142 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.network.neutron [None req-98e6a1ed-d730-450d-9a49-a8f289551073 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] validate_networks() for [('bfbea54a-6e02-4895-9b85-ca7cad74aeed', None, None, None, None, None)] {{(pid=118476) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 05:30:51.731220 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-2a30f9e2-5dde-46b7-8586-8c3a423c6c68 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:30:51.733357 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-2a30f9e2-5dde-46b7-8586-8c3a423c6c68 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] [instance: 8558ff08-5004-4dc4-892d-5b6610ce6bec] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:30:51.745666 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-2a30f9e2-5dde-46b7-8586-8c3a423c6c68 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:30:51.746398 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-2a30f9e2-5dde-46b7-8586-8c3a423c6c68 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:30:51.747554 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-2a30f9e2-5dde-46b7-8586-8c3a423c6c68 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:30:51.748716 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-2a30f9e2-5dde-46b7-8586-8c3a423c6c68 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:30:52.036186 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-2a30f9e2-5dde-46b7-8586-8c3a423c6c68 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965cf2aad5bc4def9fca55aac87cc37e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32569df1dca45cebcdd63d03ff5abae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:30:52.044999 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-2a30f9e2-5dde-46b7-8586-8c3a423c6c68 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] 10.222.0.46 "GET /compute/v2.1/servers/8558ff08-5004-4dc4-892d-5b6610ce6bec" status: 200 len: 1576 microversion: 2.1 time: 0.325427 Aug 04 05:30:52.045677 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 315/626] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:30:51 2022] GET /compute/v2.1/servers/8558ff08-5004-4dc4-892d-5b6610ce6bec => generated 1576 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:30:52.050556 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-590fecd5-194a-4ed7-9893-d9461c07632a tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-967116358", "imageRef": "4613f7d0-37ca-46ad-bb26-dc4990dd7d6f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "87f9b625-400f-447c-aea1-da3d6773a311"}], "security_groups": [{"name": "tempest-securitygroup--1308624169"}], "key_name": "tempest-keypair-557213845", "user_data": "}} {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:30:52.065809 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.virt.hardware [None req-98e6a1ed-d730-450d-9a49-a8f289551073 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Flavor limits 0:0:0 {{(pid=118476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 05:30:52.066290 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.virt.hardware [None req-98e6a1ed-d730-450d-9a49-a8f289551073 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Image limits 0:0:0 {{(pid=118476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 05:30:52.066893 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.virt.hardware [None req-98e6a1ed-d730-450d-9a49-a8f289551073 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Flavor pref 0:0:0 {{(pid=118476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 05:30:52.067300 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.virt.hardware [None req-98e6a1ed-d730-450d-9a49-a8f289551073 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Image pref 0:0:0 {{(pid=118476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 05:30:52.067708 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.virt.hardware [None req-98e6a1ed-d730-450d-9a49-a8f289551073 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 05:30:52.077996 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-98e6a1ed-d730-450d-9a49-a8f289551073 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:30:52.083374 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-98e6a1ed-d730-450d-9a49-a8f289551073 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:30:52.083374 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-98e6a1ed-d730-450d-9a49-a8f289551073 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:30:52.083374 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-98e6a1ed-d730-450d-9a49-a8f289551073 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:30:52.098293 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.quota [None req-98e6a1ed-d730-450d-9a49-a8f289551073 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Getting quotas for project d1ca4b83dc874bda9f33e06f4910608c. Resources: {'instances', 'cores', 'ram'} {{(pid=118476) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 05:30:52.103002 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.quota [None req-98e6a1ed-d730-450d-9a49-a8f289551073 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Getting quotas for user eb4dea95659c473b9b193c6234186430 and project d1ca4b83dc874bda9f33e06f4910608c. Resources: {'instances', 'cores', 'ram'} {{(pid=118476) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 05:30:52.118487 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-98e6a1ed-d730-450d-9a49-a8f289551073 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Going to run 1 instances... {{(pid=118476) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 05:30:52.118487 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-98e6a1ed-d730-450d-9a49-a8f289551073 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] [instance: 938a0d12-9045-4220-b0ee-a4ed0a3c4b6a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4613f7d0-37ca-46ad-bb26-dc4990dd7d6f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118476) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 05:30:52.195921 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.network.neutron [None req-590fecd5-194a-4ed7-9893-d9461c07632a tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] validate_networks() for [('87f9b625-400f-447c-aea1-da3d6773a311', None, None, None, None, None)] {{(pid=118477) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 05:30:52.306209 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-98e6a1ed-d730-450d-9a49-a8f289551073 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.966405 Aug 04 05:30:52.307186 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 312/627] 10.222.0.46 () {60 vars in 1147 bytes} [Thu Aug 4 05:30:51 2022] POST /compute/v2.1/servers => generated 402 bytes in 969 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 05:30:52.323708 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-77ae8294-e9c2-4198-8bc7-2059a9c95f38 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:30:52.327883 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-77ae8294-e9c2-4198-8bc7-2059a9c95f38 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] [instance: 938a0d12-9045-4220-b0ee-a4ed0a3c4b6a] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:30:52.466646 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-77ae8294-e9c2-4198-8bc7-2059a9c95f38 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb4dea95659c473b9b193c6234186430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1ca4b83dc874bda9f33e06f4910608c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:30:52.479562 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-77ae8294-e9c2-4198-8bc7-2059a9c95f38 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] 10.222.0.46 "GET /compute/v2.1/servers/938a0d12-9045-4220-b0ee-a4ed0a3c4b6a" status: 200 len: 1237 microversion: 2.1 time: 0.165456 Aug 04 05:30:52.482325 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 313/628] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:30:52 2022] GET /compute/v2.1/servers/938a0d12-9045-4220-b0ee-a4ed0a3c4b6a => generated 1237 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 05:30:52.786638 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.virt.hardware [None req-590fecd5-194a-4ed7-9893-d9461c07632a tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Flavor limits 0:0:0 {{(pid=118477) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 05:30:52.787139 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.virt.hardware [None req-590fecd5-194a-4ed7-9893-d9461c07632a tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Image limits 0:0:0 {{(pid=118477) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 05:30:52.787947 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.virt.hardware [None req-590fecd5-194a-4ed7-9893-d9461c07632a tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Flavor pref 0:0:0 {{(pid=118477) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 05:30:52.788478 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.virt.hardware [None req-590fecd5-194a-4ed7-9893-d9461c07632a tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Image pref 0:0:0 {{(pid=118477) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 05:30:52.789061 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.virt.hardware [None req-590fecd5-194a-4ed7-9893-d9461c07632a tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118477) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 05:30:52.798298 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-590fecd5-194a-4ed7-9893-d9461c07632a tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:30:52.798776 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-590fecd5-194a-4ed7-9893-d9461c07632a tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:30:52.799574 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-590fecd5-194a-4ed7-9893-d9461c07632a tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:30:52.799998 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-590fecd5-194a-4ed7-9893-d9461c07632a tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:30:52.818431 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.quota [None req-590fecd5-194a-4ed7-9893-d9461c07632a tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Getting quotas for project faead990837d43de8ec54bfaf24361de. Resources: {'instances', 'cores', 'ram'} {{(pid=118477) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 05:30:52.824124 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.quota [None req-590fecd5-194a-4ed7-9893-d9461c07632a tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Getting quotas for user 9cb49b631c234f9a9fd47049b9b2e097 and project faead990837d43de8ec54bfaf24361de. Resources: {'instances', 'cores', 'ram'} {{(pid=118477) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 05:30:52.837890 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-590fecd5-194a-4ed7-9893-d9461c07632a tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Going to run 1 instances... {{(pid=118477) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 05:30:52.840252 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-590fecd5-194a-4ed7-9893-d9461c07632a tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] [instance: 81874e0c-3350-44a3-8108-be514b727575] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4613f7d0-37ca-46ad-bb26-dc4990dd7d6f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118477) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 05:30:52.948014 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-590fecd5-194a-4ed7-9893-d9461c07632a tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.901242 Aug 04 05:30:52.954974 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 316/629] 10.222.0.46 () {60 vars in 1147 bytes} [Thu Aug 4 05:30:52 2022] POST /compute/v2.1/servers => generated 402 bytes in 903 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 05:30:52.961404 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-c7cbf427-8fc9-410e-bd10-ab4c512b2f23 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:30:52.962134 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-c7cbf427-8fc9-410e-bd10-ab4c512b2f23 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] [instance: 81874e0c-3350-44a3-8108-be514b727575] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:30:53.019792 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-c7cbf427-8fc9-410e-bd10-ab4c512b2f23 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb49b631c234f9a9fd47049b9b2e097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faead990837d43de8ec54bfaf24361de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:30:53.028272 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-c7cbf427-8fc9-410e-bd10-ab4c512b2f23 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] 10.222.0.46 "GET /compute/v2.1/servers/81874e0c-3350-44a3-8108-be514b727575" status: 200 len: 1240 microversion: 2.1 time: 0.071944 Aug 04 05:30:53.028964 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 314/630] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:30:52 2022] GET /compute/v2.1/servers/81874e0c-3350-44a3-8108-be514b727575 => generated 1240 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 05:30:53.068061 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-c7a71dc0-4c94-4513-be08-87152b706b0d tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:30:53.068704 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-c7a71dc0-4c94-4513-be08-87152b706b0d tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] [instance: 8558ff08-5004-4dc4-892d-5b6610ce6bec] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:30:53.075593 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-c7a71dc0-4c94-4513-be08-87152b706b0d tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:30:53.076034 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-c7a71dc0-4c94-4513-be08-87152b706b0d tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:30:53.076994 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-c7a71dc0-4c94-4513-be08-87152b706b0d tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:30:53.077425 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-c7a71dc0-4c94-4513-be08-87152b706b0d tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:30:53.229482 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-c7a71dc0-4c94-4513-be08-87152b706b0d tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965cf2aad5bc4def9fca55aac87cc37e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32569df1dca45cebcdd63d03ff5abae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:30:53.237153 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-c7a71dc0-4c94-4513-be08-87152b706b0d tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] 10.222.0.46 "GET /compute/v2.1/servers/8558ff08-5004-4dc4-892d-5b6610ce6bec" status: 200 len: 1576 microversion: 2.1 time: 0.173146 Aug 04 05:30:53.242974 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 317/631] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:30:53 2022] GET /compute/v2.1/servers/8558ff08-5004-4dc4-892d-5b6610ce6bec => generated 1576 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:30:53.504396 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-14dd4148-0f1c-4eb4-8432-c8009a31bd04 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:30:53.505098 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-14dd4148-0f1c-4eb4-8432-c8009a31bd04 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] [instance: 938a0d12-9045-4220-b0ee-a4ed0a3c4b6a] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:30:53.513020 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-14dd4148-0f1c-4eb4-8432-c8009a31bd04 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:30:53.513566 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-14dd4148-0f1c-4eb4-8432-c8009a31bd04 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:30:53.514770 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-14dd4148-0f1c-4eb4-8432-c8009a31bd04 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:30:53.515271 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-14dd4148-0f1c-4eb4-8432-c8009a31bd04 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:30:53.585843 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-14dd4148-0f1c-4eb4-8432-c8009a31bd04 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb4dea95659c473b9b193c6234186430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1ca4b83dc874bda9f33e06f4910608c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:30:53.596864 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-14dd4148-0f1c-4eb4-8432-c8009a31bd04 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] 10.222.0.46 "GET /compute/v2.1/servers/938a0d12-9045-4220-b0ee-a4ed0a3c4b6a" status: 200 len: 1241 microversion: 2.1 time: 0.097445 Aug 04 05:30:53.597696 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 315/632] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:30:53 2022] GET /compute/v2.1/servers/938a0d12-9045-4220-b0ee-a4ed0a3c4b6a => generated 1241 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:30:54.049305 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-74cc786d-5941-4225-8fc3-32e36d2ba565 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:30:54.049903 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-74cc786d-5941-4225-8fc3-32e36d2ba565 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] [instance: 81874e0c-3350-44a3-8108-be514b727575] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:30:54.057087 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-74cc786d-5941-4225-8fc3-32e36d2ba565 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:30:54.057528 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-74cc786d-5941-4225-8fc3-32e36d2ba565 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:30:54.058281 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-74cc786d-5941-4225-8fc3-32e36d2ba565 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:30:54.058741 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-74cc786d-5941-4225-8fc3-32e36d2ba565 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:30:54.120209 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-74cc786d-5941-4225-8fc3-32e36d2ba565 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb49b631c234f9a9fd47049b9b2e097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faead990837d43de8ec54bfaf24361de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:30:54.127979 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-74cc786d-5941-4225-8fc3-32e36d2ba565 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] 10.222.0.46 "GET /compute/v2.1/servers/81874e0c-3350-44a3-8108-be514b727575" status: 200 len: 1244 microversion: 2.1 time: 0.082461 Aug 04 05:30:54.128557 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 318/633] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:30:54 2022] GET /compute/v2.1/servers/81874e0c-3350-44a3-8108-be514b727575 => generated 1244 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:30:54.260013 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-e3db4725-ae9c-4251-b3ec-746403d0b5c9 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:30:54.260655 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-e3db4725-ae9c-4251-b3ec-746403d0b5c9 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] [instance: 8558ff08-5004-4dc4-892d-5b6610ce6bec] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:30:54.266756 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-e3db4725-ae9c-4251-b3ec-746403d0b5c9 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:30:54.267210 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-e3db4725-ae9c-4251-b3ec-746403d0b5c9 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:30:54.267981 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-e3db4725-ae9c-4251-b3ec-746403d0b5c9 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:30:54.268420 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-e3db4725-ae9c-4251-b3ec-746403d0b5c9 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:30:54.417565 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-e3db4725-ae9c-4251-b3ec-746403d0b5c9 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965cf2aad5bc4def9fca55aac87cc37e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32569df1dca45cebcdd63d03ff5abae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:30:54.425129 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-e3db4725-ae9c-4251-b3ec-746403d0b5c9 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] 10.222.0.46 "GET /compute/v2.1/servers/8558ff08-5004-4dc4-892d-5b6610ce6bec" status: 200 len: 1576 microversion: 2.1 time: 0.169130 Aug 04 05:30:54.425710 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 316/634] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:30:54 2022] GET /compute/v2.1/servers/8558ff08-5004-4dc4-892d-5b6610ce6bec => generated 1576 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:30:54.624131 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-913d7bc3-0c42-4c0f-8a96-afcb1b31b0c8 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:30:54.624131 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-913d7bc3-0c42-4c0f-8a96-afcb1b31b0c8 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] [instance: 938a0d12-9045-4220-b0ee-a4ed0a3c4b6a] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:30:54.625428 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-913d7bc3-0c42-4c0f-8a96-afcb1b31b0c8 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:30:54.625771 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-913d7bc3-0c42-4c0f-8a96-afcb1b31b0c8 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:30:54.626574 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-913d7bc3-0c42-4c0f-8a96-afcb1b31b0c8 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:30:54.627007 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-913d7bc3-0c42-4c0f-8a96-afcb1b31b0c8 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:30:54.693588 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-913d7bc3-0c42-4c0f-8a96-afcb1b31b0c8 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb4dea95659c473b9b193c6234186430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1ca4b83dc874bda9f33e06f4910608c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:30:54.701117 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-913d7bc3-0c42-4c0f-8a96-afcb1b31b0c8 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] 10.222.0.46 "GET /compute/v2.1/servers/938a0d12-9045-4220-b0ee-a4ed0a3c4b6a" status: 200 len: 1241 microversion: 2.1 time: 0.086765 Aug 04 05:30:54.701695 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 319/635] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:30:54 2022] GET /compute/v2.1/servers/938a0d12-9045-4220-b0ee-a4ed0a3c4b6a => generated 1241 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:30:55.150011 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-b24c392b-d93a-421c-b48a-b49cc3d0ce32 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:30:55.150658 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-b24c392b-d93a-421c-b48a-b49cc3d0ce32 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] [instance: 81874e0c-3350-44a3-8108-be514b727575] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:30:55.158571 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-b24c392b-d93a-421c-b48a-b49cc3d0ce32 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:30:55.159213 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-b24c392b-d93a-421c-b48a-b49cc3d0ce32 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:30:55.160157 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-b24c392b-d93a-421c-b48a-b49cc3d0ce32 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:30:55.160596 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-b24c392b-d93a-421c-b48a-b49cc3d0ce32 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:30:55.242363 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-b24c392b-d93a-421c-b48a-b49cc3d0ce32 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb49b631c234f9a9fd47049b9b2e097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faead990837d43de8ec54bfaf24361de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:30:55.250229 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-b24c392b-d93a-421c-b48a-b49cc3d0ce32 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] 10.222.0.46 "GET /compute/v2.1/servers/81874e0c-3350-44a3-8108-be514b727575" status: 200 len: 1244 microversion: 2.1 time: 0.104252 Aug 04 05:30:55.250860 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 317/636] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:30:55 2022] GET /compute/v2.1/servers/81874e0c-3350-44a3-8108-be514b727575 => generated 1244 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:30:55.447863 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-96c60408-5939-4593-9e03-347abfc44ecc tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:30:55.449577 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-96c60408-5939-4593-9e03-347abfc44ecc tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] [instance: 8558ff08-5004-4dc4-892d-5b6610ce6bec] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:30:55.455166 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-96c60408-5939-4593-9e03-347abfc44ecc tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:30:55.455614 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-96c60408-5939-4593-9e03-347abfc44ecc tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:30:55.456419 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-96c60408-5939-4593-9e03-347abfc44ecc tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:30:55.457037 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-96c60408-5939-4593-9e03-347abfc44ecc tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:30:55.632540 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-b887b646-b467-47f6-990c-ed57e7b04b64 tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-425982178", "imageRef": "4613f7d0-37ca-46ad-bb26-dc4990dd7d6f", "flavorRef": "452", "networks": [{"uuid": "65f8e2c1-d62e-4f2c-97e3-127a3a6cd56e"}]}} {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:30:55.671109 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-96c60408-5939-4593-9e03-347abfc44ecc tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965cf2aad5bc4def9fca55aac87cc37e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32569df1dca45cebcdd63d03ff5abae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:30:55.673603 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-96c60408-5939-4593-9e03-347abfc44ecc tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] 10.222.0.46 "GET /compute/v2.1/servers/8558ff08-5004-4dc4-892d-5b6610ce6bec" status: 200 len: 1576 microversion: 2.1 time: 0.229694 Aug 04 05:30:55.674443 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 320/637] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:30:55 2022] GET /compute/v2.1/servers/8558ff08-5004-4dc4-892d-5b6610ce6bec => generated 1576 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:30:55.718767 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.network.neutron [None req-b887b646-b467-47f6-990c-ed57e7b04b64 tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] validate_networks() for [('65f8e2c1-d62e-4f2c-97e3-127a3a6cd56e', None, None, None, None, None)] {{(pid=118476) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 05:30:55.724707 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-4fead46d-bb99-4c42-a114-38a9a8f2a3f9 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:30:55.734416 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-4fead46d-bb99-4c42-a114-38a9a8f2a3f9 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] [instance: 938a0d12-9045-4220-b0ee-a4ed0a3c4b6a] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:30:55.749971 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-4fead46d-bb99-4c42-a114-38a9a8f2a3f9 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:30:55.750464 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-4fead46d-bb99-4c42-a114-38a9a8f2a3f9 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:30:55.751310 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-4fead46d-bb99-4c42-a114-38a9a8f2a3f9 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:30:55.751747 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-4fead46d-bb99-4c42-a114-38a9a8f2a3f9 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:30:55.860386 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-4fead46d-bb99-4c42-a114-38a9a8f2a3f9 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb4dea95659c473b9b193c6234186430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1ca4b83dc874bda9f33e06f4910608c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:30:55.871940 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-4fead46d-bb99-4c42-a114-38a9a8f2a3f9 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] 10.222.0.46 "GET /compute/v2.1/servers/938a0d12-9045-4220-b0ee-a4ed0a3c4b6a" status: 200 len: 1289 microversion: 2.1 time: 0.152765 Aug 04 05:30:55.884225 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 321/638] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:30:55 2022] GET /compute/v2.1/servers/938a0d12-9045-4220-b0ee-a4ed0a3c4b6a => generated 1289 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 05:30:56.273223 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-ee88f5d4-5d46-4771-824a-9c56e875d1fe tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:30:56.273855 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-ee88f5d4-5d46-4771-824a-9c56e875d1fe tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] [instance: 81874e0c-3350-44a3-8108-be514b727575] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:30:56.276011 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG dbcounter [-] [118477] Writing DB stats nova_api:SELECT=94,nova_api:DELETE=1,nova_api:INSERT=5 {{(pid=118477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:30:56.286154 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-ee88f5d4-5d46-4771-824a-9c56e875d1fe tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:30:56.287017 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-ee88f5d4-5d46-4771-824a-9c56e875d1fe tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:30:56.289269 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-ee88f5d4-5d46-4771-824a-9c56e875d1fe tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:30:56.289938 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-ee88f5d4-5d46-4771-824a-9c56e875d1fe tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:30:56.461739 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-ee88f5d4-5d46-4771-824a-9c56e875d1fe tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb49b631c234f9a9fd47049b9b2e097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faead990837d43de8ec54bfaf24361de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:30:56.464795 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG dbcounter [-] [118477] Writing DB stats nova_cell1:SELECT=100 {{(pid=118477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:30:56.474516 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-ee88f5d4-5d46-4771-824a-9c56e875d1fe tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] 10.222.0.46 "GET /compute/v2.1/servers/81874e0c-3350-44a3-8108-be514b727575" status: 200 len: 1292 microversion: 2.1 time: 0.206755 Aug 04 05:30:56.479398 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 322/639] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:30:56 2022] GET /compute/v2.1/servers/81874e0c-3350-44a3-8108-be514b727575 => generated 1292 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 05:30:56.588780 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.virt.hardware [None req-b887b646-b467-47f6-990c-ed57e7b04b64 tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] Flavor limits 0:0:0 {{(pid=118476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 05:30:56.589804 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.virt.hardware [None req-b887b646-b467-47f6-990c-ed57e7b04b64 tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] Image limits 0:0:0 {{(pid=118476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 05:30:56.590337 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.virt.hardware [None req-b887b646-b467-47f6-990c-ed57e7b04b64 tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] Flavor pref 0:0:0 {{(pid=118476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 05:30:56.590766 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.virt.hardware [None req-b887b646-b467-47f6-990c-ed57e7b04b64 tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] Image pref 0:0:0 {{(pid=118476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 05:30:56.592338 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.virt.hardware [None req-b887b646-b467-47f6-990c-ed57e7b04b64 tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 05:30:56.613065 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-b887b646-b467-47f6-990c-ed57e7b04b64 tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:30:56.613917 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-b887b646-b467-47f6-990c-ed57e7b04b64 tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:30:56.615074 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-b887b646-b467-47f6-990c-ed57e7b04b64 tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:30:56.615651 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-b887b646-b467-47f6-990c-ed57e7b04b64 tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:30:56.632041 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG dbcounter [-] [118476] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=118476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:30:56.637859 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.quota [None req-b887b646-b467-47f6-990c-ed57e7b04b64 tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] Getting quotas for project 520d3d5e2e804be1bd5dc9bfc50c5de8. Resources: {'instances', 'cores', 'ram'} {{(pid=118476) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 05:30:56.642111 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.quota [None req-b887b646-b467-47f6-990c-ed57e7b04b64 tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] Getting quotas for user 5af2248451d3483d9742887d614a5077 and project 520d3d5e2e804be1bd5dc9bfc50c5de8. Resources: {'instances', 'cores', 'ram'} {{(pid=118476) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 05:30:56.659057 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-b887b646-b467-47f6-990c-ed57e7b04b64 tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] Going to run 1 instances... {{(pid=118476) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 05:30:56.661590 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-b887b646-b467-47f6-990c-ed57e7b04b64 tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] [instance: 3dfe0046-8259-4d54-9bd3-5031b4eedeb3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4613f7d0-37ca-46ad-bb26-dc4990dd7d6f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118476) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 05:30:56.695956 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-fa35999f-74a2-4ca3-9b31-b24ee2ebaebf tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:30:56.696950 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-fa35999f-74a2-4ca3-9b31-b24ee2ebaebf tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] [instance: 8558ff08-5004-4dc4-892d-5b6610ce6bec] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:30:56.714161 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-fa35999f-74a2-4ca3-9b31-b24ee2ebaebf tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:30:56.714865 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-fa35999f-74a2-4ca3-9b31-b24ee2ebaebf tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:30:56.715938 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-fa35999f-74a2-4ca3-9b31-b24ee2ebaebf tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:30:56.719295 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-fa35999f-74a2-4ca3-9b31-b24ee2ebaebf tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:30:56.864372 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-b887b646-b467-47f6-990c-ed57e7b04b64 tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.236210 Aug 04 05:30:56.867665 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 318/640] 10.222.0.46 () {60 vars in 1147 bytes} [Thu Aug 4 05:30:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 1240 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 04 05:30:56.878648 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-591c10cf-d436-452f-a34b-827212b709a5 tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:30:56.879394 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-591c10cf-d436-452f-a34b-827212b709a5 tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] [instance: 3dfe0046-8259-4d54-9bd3-5031b4eedeb3] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:30:57.056365 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-fa35999f-74a2-4ca3-9b31-b24ee2ebaebf tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965cf2aad5bc4def9fca55aac87cc37e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32569df1dca45cebcdd63d03ff5abae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:30:57.070122 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-fa35999f-74a2-4ca3-9b31-b24ee2ebaebf tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] 10.222.0.46 "GET /compute/v2.1/servers/8558ff08-5004-4dc4-892d-5b6610ce6bec" status: 200 len: 1576 microversion: 2.1 time: 0.377913 Aug 04 05:30:57.070866 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 323/641] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:30:56 2022] GET /compute/v2.1/servers/8558ff08-5004-4dc4-892d-5b6610ce6bec => generated 1576 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 05:30:57.079949 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-591c10cf-d436-452f-a34b-827212b709a5 tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5af2248451d3483d9742887d614a5077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520d3d5e2e804be1bd5dc9bfc50c5de8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:30:57.091429 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-622f9e73-19a2-4367-9f1a-7cdade067613 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:30:57.092391 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-591c10cf-d436-452f-a34b-827212b709a5 tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] 10.222.0.46 "GET /compute/v2.1/servers/3dfe0046-8259-4d54-9bd3-5031b4eedeb3" status: 200 len: 1218 microversion: 2.1 time: 0.217610 Aug 04 05:30:57.092604 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-622f9e73-19a2-4367-9f1a-7cdade067613 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] [instance: 938a0d12-9045-4220-b0ee-a4ed0a3c4b6a] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:30:57.097053 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 319/642] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:30:56 2022] GET /compute/v2.1/servers/3dfe0046-8259-4d54-9bd3-5031b4eedeb3 => generated 1218 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:30:57.107499 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-622f9e73-19a2-4367-9f1a-7cdade067613 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:30:57.108196 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-622f9e73-19a2-4367-9f1a-7cdade067613 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:30:57.119437 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-622f9e73-19a2-4367-9f1a-7cdade067613 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:30:57.121151 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-622f9e73-19a2-4367-9f1a-7cdade067613 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:30:57.216457 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-622f9e73-19a2-4367-9f1a-7cdade067613 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb4dea95659c473b9b193c6234186430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1ca4b83dc874bda9f33e06f4910608c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:30:57.224226 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-622f9e73-19a2-4367-9f1a-7cdade067613 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] 10.222.0.46 "GET /compute/v2.1/servers/938a0d12-9045-4220-b0ee-a4ed0a3c4b6a" status: 200 len: 1307 microversion: 2.1 time: 0.137114 Aug 04 05:30:57.258097 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 324/643] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:30:57 2022] GET /compute/v2.1/servers/938a0d12-9045-4220-b0ee-a4ed0a3c4b6a => generated 1307 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:30:57.500874 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-b84849ae-6c69-4823-a722-3697b7282f06 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:30:57.501860 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-b84849ae-6c69-4823-a722-3697b7282f06 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] [instance: 81874e0c-3350-44a3-8108-be514b727575] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:30:57.509849 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-b84849ae-6c69-4823-a722-3697b7282f06 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:30:57.510691 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-b84849ae-6c69-4823-a722-3697b7282f06 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:30:57.511693 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-b84849ae-6c69-4823-a722-3697b7282f06 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:30:57.512374 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-b84849ae-6c69-4823-a722-3697b7282f06 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:30:57.613303 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-b84849ae-6c69-4823-a722-3697b7282f06 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb49b631c234f9a9fd47049b9b2e097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faead990837d43de8ec54bfaf24361de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:30:57.624775 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-b84849ae-6c69-4823-a722-3697b7282f06 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] 10.222.0.46 "GET /compute/v2.1/servers/81874e0c-3350-44a3-8108-be514b727575" status: 200 len: 1298 microversion: 2.1 time: 0.127495 Aug 04 05:30:57.626056 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 320/644] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:30:57 2022] GET /compute/v2.1/servers/81874e0c-3350-44a3-8108-be514b727575 => generated 1298 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:30:58.090750 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-ca5c3e8a-076a-4b3a-8bc0-6fa16b92bfca tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:30:58.092090 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-ca5c3e8a-076a-4b3a-8bc0-6fa16b92bfca tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] [instance: 8558ff08-5004-4dc4-892d-5b6610ce6bec] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:30:58.098982 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-ca5c3e8a-076a-4b3a-8bc0-6fa16b92bfca tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:30:58.099792 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-ca5c3e8a-076a-4b3a-8bc0-6fa16b92bfca tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:30:58.101504 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-ca5c3e8a-076a-4b3a-8bc0-6fa16b92bfca tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:30:58.102176 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-ca5c3e8a-076a-4b3a-8bc0-6fa16b92bfca tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:30:58.115912 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-5f970e65-8b7a-4f6d-838c-f6ea5aff7bf1 tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:30:58.117783 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-5f970e65-8b7a-4f6d-838c-f6ea5aff7bf1 tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] [instance: 3dfe0046-8259-4d54-9bd3-5031b4eedeb3] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:30:58.125041 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-5f970e65-8b7a-4f6d-838c-f6ea5aff7bf1 tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:30:58.125811 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-5f970e65-8b7a-4f6d-838c-f6ea5aff7bf1 tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:30:58.126842 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-5f970e65-8b7a-4f6d-838c-f6ea5aff7bf1 tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:30:58.127487 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-5f970e65-8b7a-4f6d-838c-f6ea5aff7bf1 tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:30:58.325527 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-5f970e65-8b7a-4f6d-838c-f6ea5aff7bf1 tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5af2248451d3483d9742887d614a5077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520d3d5e2e804be1bd5dc9bfc50c5de8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:30:58.333264 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-5f970e65-8b7a-4f6d-838c-f6ea5aff7bf1 tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] 10.222.0.46 "GET /compute/v2.1/servers/3dfe0046-8259-4d54-9bd3-5031b4eedeb3" status: 200 len: 1222 microversion: 2.1 time: 0.221100 Aug 04 05:30:58.346796 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 321/645] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:30:58 2022] GET /compute/v2.1/servers/3dfe0046-8259-4d54-9bd3-5031b4eedeb3 => generated 1222 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 05:30:58.356208 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-052a0618-cdce-4916-8dc7-136982713228 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:30:58.356821 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-052a0618-cdce-4916-8dc7-136982713228 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] [instance: 938a0d12-9045-4220-b0ee-a4ed0a3c4b6a] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:30:58.363546 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-052a0618-cdce-4916-8dc7-136982713228 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:30:58.364331 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-052a0618-cdce-4916-8dc7-136982713228 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:30:58.365326 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-052a0618-cdce-4916-8dc7-136982713228 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:30:58.366035 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-052a0618-cdce-4916-8dc7-136982713228 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:30:58.488724 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-052a0618-cdce-4916-8dc7-136982713228 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb4dea95659c473b9b193c6234186430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1ca4b83dc874bda9f33e06f4910608c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:30:58.497805 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-052a0618-cdce-4916-8dc7-136982713228 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] 10.222.0.46 "GET /compute/v2.1/servers/938a0d12-9045-4220-b0ee-a4ed0a3c4b6a" status: 200 len: 1295 microversion: 2.1 time: 0.145487 Aug 04 05:30:58.500063 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-ca5c3e8a-076a-4b3a-8bc0-6fa16b92bfca tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965cf2aad5bc4def9fca55aac87cc37e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32569df1dca45cebcdd63d03ff5abae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:30:58.513083 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-ca5c3e8a-076a-4b3a-8bc0-6fa16b92bfca tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] 10.222.0.46 "GET /compute/v2.1/servers/8558ff08-5004-4dc4-892d-5b6610ce6bec" status: 200 len: 1576 microversion: 2.1 time: 0.426140 Aug 04 05:30:58.513660 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 325/647] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:30:58 2022] GET /compute/v2.1/servers/8558ff08-5004-4dc4-892d-5b6610ce6bec => generated 1576 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:30:58.533696 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 322/647] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:30:58 2022] GET /compute/v2.1/servers/938a0d12-9045-4220-b0ee-a4ed0a3c4b6a => generated 1295 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:30:58.648571 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-45478644-7121-456f-8dee-18955c24bbf6 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:30:58.649325 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-45478644-7121-456f-8dee-18955c24bbf6 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] [instance: 81874e0c-3350-44a3-8108-be514b727575] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:30:58.659087 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-45478644-7121-456f-8dee-18955c24bbf6 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:30:58.660603 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-45478644-7121-456f-8dee-18955c24bbf6 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:30:58.663536 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-45478644-7121-456f-8dee-18955c24bbf6 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:30:58.663536 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-45478644-7121-456f-8dee-18955c24bbf6 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:30:59.095904 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-45478644-7121-456f-8dee-18955c24bbf6 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb49b631c234f9a9fd47049b9b2e097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faead990837d43de8ec54bfaf24361de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:30:59.105118 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-45478644-7121-456f-8dee-18955c24bbf6 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] 10.222.0.46 "GET /compute/v2.1/servers/81874e0c-3350-44a3-8108-be514b727575" status: 200 len: 1366 microversion: 2.1 time: 0.460409 Aug 04 05:30:59.122747 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 326/648] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:30:58 2022] GET /compute/v2.1/servers/81874e0c-3350-44a3-8108-be514b727575 => generated 1366 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:30:59.356495 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-5bac34af-0de5-4ba2-8dea-384f222384c7 tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:30:59.356495 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-5bac34af-0de5-4ba2-8dea-384f222384c7 tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] [instance: 3dfe0046-8259-4d54-9bd3-5031b4eedeb3] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:30:59.365782 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-5bac34af-0de5-4ba2-8dea-384f222384c7 tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:30:59.366546 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-5bac34af-0de5-4ba2-8dea-384f222384c7 tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:30:59.367311 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-5bac34af-0de5-4ba2-8dea-384f222384c7 tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:30:59.367754 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-5bac34af-0de5-4ba2-8dea-384f222384c7 tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:30:59.466862 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-686e14ee-9004-44c1-b02c-749cb135f936 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Action: 'create', calling method: .version_select at 0x7f147540ad30>, body: {"keypair": {"name": "tempest-keypair-805187364", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJNdRMz8wyI10FLMnUa/4YnbAE3of8SHDyz/PdRsd6tgVOI49xYfBDL5b5xABgEF7LQ7bys1h2i2322nJmoYcEYYOKvb8O4KzwTXJfjFZ/nKxJtDX20b568ZzpkjtviC7w=="}} {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:30:59.503930 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-5bac34af-0de5-4ba2-8dea-384f222384c7 tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5af2248451d3483d9742887d614a5077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520d3d5e2e804be1bd5dc9bfc50c5de8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:30:59.507624 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.quota [None req-686e14ee-9004-44c1-b02c-749cb135f936 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Getting quotas for project 290c5e886bf64e989f2be4b94a570e3f. Resources: {'key_pairs'} {{(pid=118476) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 05:30:59.518274 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-5bac34af-0de5-4ba2-8dea-384f222384c7 tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] 10.222.0.46 "GET /compute/v2.1/servers/3dfe0046-8259-4d54-9bd3-5031b4eedeb3" status: 200 len: 1270 microversion: 2.1 time: 0.167463 Aug 04 05:30:59.521146 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 327/649] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:30:59 2022] GET /compute/v2.1/servers/3dfe0046-8259-4d54-9bd3-5031b4eedeb3 => generated 1270 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 05:30:59.536460 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-5a8a1db2-cb69-4148-b273-791f7588b7eb tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:30:59.541525 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-5a8a1db2-cb69-4148-b273-791f7588b7eb tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] [instance: 938a0d12-9045-4220-b0ee-a4ed0a3c4b6a] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:30:59.541667 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.quota [None req-686e14ee-9004-44c1-b02c-749cb135f936 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Getting quotas for user fd2797b8820c41a2ae939fd7c473a549 and project 290c5e886bf64e989f2be4b94a570e3f. Resources: {'key_pairs'} {{(pid=118476) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 05:30:59.566769 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-5a8a1db2-cb69-4148-b273-791f7588b7eb tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:30:59.567492 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-5a8a1db2-cb69-4148-b273-791f7588b7eb tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:30:59.568492 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-5a8a1db2-cb69-4148-b273-791f7588b7eb tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:30:59.568931 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-5a8a1db2-cb69-4148-b273-791f7588b7eb tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:30:59.659230 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-686e14ee-9004-44c1-b02c-749cb135f936 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.356148 Aug 04 05:30:59.667722 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 323/650] 10.222.0.46 () {62 vars in 1200 bytes} [Thu Aug 4 05:30:59 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 358 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 04 05:30:59.667722 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-265ee1e8-9fac-4c6a-badc-fedb1fdadd2f tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:30:59.667722 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-265ee1e8-9fac-4c6a-badc-fedb1fdadd2f tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] [instance: 8558ff08-5004-4dc4-892d-5b6610ce6bec] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:30:59.675405 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-265ee1e8-9fac-4c6a-badc-fedb1fdadd2f tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:30:59.676205 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-265ee1e8-9fac-4c6a-badc-fedb1fdadd2f tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:30:59.677236 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-265ee1e8-9fac-4c6a-badc-fedb1fdadd2f tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:30:59.677902 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-265ee1e8-9fac-4c6a-badc-fedb1fdadd2f tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:31:00.013233 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-5a8a1db2-cb69-4148-b273-791f7588b7eb tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb4dea95659c473b9b193c6234186430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1ca4b83dc874bda9f33e06f4910608c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:31:00.024287 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-5a8a1db2-cb69-4148-b273-791f7588b7eb tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] 10.222.0.46 "GET /compute/v2.1/servers/938a0d12-9045-4220-b0ee-a4ed0a3c4b6a" status: 200 len: 1363 microversion: 2.1 time: 0.501866 Aug 04 05:31:00.038891 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 328/651] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:30:59 2022] GET /compute/v2.1/servers/938a0d12-9045-4220-b0ee-a4ed0a3c4b6a => generated 1363 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:31:00.129056 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-8d6bbeab-d917-42a0-a669-1be72c14f412 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:31:00.129756 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-8d6bbeab-d917-42a0-a669-1be72c14f412 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] [instance: 81874e0c-3350-44a3-8108-be514b727575] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:31:00.137278 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-8d6bbeab-d917-42a0-a669-1be72c14f412 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:31:00.138589 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-8d6bbeab-d917-42a0-a669-1be72c14f412 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:31:00.145456 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-8d6bbeab-d917-42a0-a669-1be72c14f412 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:31:00.145456 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-8d6bbeab-d917-42a0-a669-1be72c14f412 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:31:00.162154 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-265ee1e8-9fac-4c6a-badc-fedb1fdadd2f tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965cf2aad5bc4def9fca55aac87cc37e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32569df1dca45cebcdd63d03ff5abae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:31:00.175004 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-265ee1e8-9fac-4c6a-badc-fedb1fdadd2f tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] 10.222.0.46 "GET /compute/v2.1/servers/8558ff08-5004-4dc4-892d-5b6610ce6bec" status: 200 len: 1576 microversion: 2.1 time: 0.513509 Aug 04 05:31:00.191153 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 324/652] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:30:59 2022] GET /compute/v2.1/servers/8558ff08-5004-4dc4-892d-5b6610ce6bec => generated 1576 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:31:00.500340 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-8d6bbeab-d917-42a0-a669-1be72c14f412 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb49b631c234f9a9fd47049b9b2e097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faead990837d43de8ec54bfaf24361de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:31:00.510571 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-8d6bbeab-d917-42a0-a669-1be72c14f412 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] 10.222.0.46 "GET /compute/v2.1/servers/81874e0c-3350-44a3-8108-be514b727575" status: 200 len: 1366 microversion: 2.1 time: 0.385327 Aug 04 05:31:00.511285 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 329/653] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:31:00 2022] GET /compute/v2.1/servers/81874e0c-3350-44a3-8108-be514b727575 => generated 1366 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 05:31:00.549435 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-f27c5a26-d42c-4336-8d27-2737bac267f7 tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:31:00.551246 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-f27c5a26-d42c-4336-8d27-2737bac267f7 tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] [instance: 3dfe0046-8259-4d54-9bd3-5031b4eedeb3] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:31:00.559796 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-f27c5a26-d42c-4336-8d27-2737bac267f7 tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:31:00.560483 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-f27c5a26-d42c-4336-8d27-2737bac267f7 tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:31:00.562371 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-f27c5a26-d42c-4336-8d27-2737bac267f7 tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:31:00.562819 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-f27c5a26-d42c-4336-8d27-2737bac267f7 tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:31:00.842685 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-f27c5a26-d42c-4336-8d27-2737bac267f7 tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5af2248451d3483d9742887d614a5077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520d3d5e2e804be1bd5dc9bfc50c5de8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:31:00.850797 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-f27c5a26-d42c-4336-8d27-2737bac267f7 tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] 10.222.0.46 "GET /compute/v2.1/servers/3dfe0046-8259-4d54-9bd3-5031b4eedeb3" status: 200 len: 1318 microversion: 2.1 time: 0.305058 Aug 04 05:31:00.851495 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 325/654] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:31:00 2022] GET /compute/v2.1/servers/3dfe0046-8259-4d54-9bd3-5031b4eedeb3 => generated 1318 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:31:00.905736 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [req-fb27973e-8b59-48d5-a70a-d7d225e94811 req-4a17d8a9-0052-4b84-8e8b-04df77e25f25 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "938a0d12-9045-4220-b0ee-a4ed0a3c4b6a", "tag": "96eaa044-09b6-458e-884c-ed2bb97c5253"}]} {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:31:00.927131 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [req-fb27973e-8b59-48d5-a70a-d7d225e94811 req-4a17d8a9-0052-4b84-8e8b-04df77e25f25 service nova] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:31:00.929362 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [req-fb27973e-8b59-48d5-a70a-d7d225e94811 req-4a17d8a9-0052-4b84-8e8b-04df77e25f25 service nova] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:31:00.943825 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.compute.server_external_events [req-fb27973e-8b59-48d5-a70a-d7d225e94811 req-4a17d8a9-0052-4b84-8e8b-04df77e25f25 service nova] Creating event network-changed:96eaa044-09b6-458e-884c-ed2bb97c5253 for instance 938a0d12-9045-4220-b0ee-a4ed0a3c4b6a on hv-cinder-85207 Aug 04 05:31:00.954377 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [req-fb27973e-8b59-48d5-a70a-d7d225e94811 req-4a17d8a9-0052-4b84-8e8b-04df77e25f25 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054151 Aug 04 05:31:00.955645 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 330/655] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Aug 4 05:31:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:31:01.047626 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-3cd77374-bd1c-41c1-8ead-0136868d0d45 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:31:01.048240 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-3cd77374-bd1c-41c1-8ead-0136868d0d45 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] [instance: 938a0d12-9045-4220-b0ee-a4ed0a3c4b6a] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:31:01.056300 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-3cd77374-bd1c-41c1-8ead-0136868d0d45 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:31:01.056756 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-3cd77374-bd1c-41c1-8ead-0136868d0d45 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:31:01.057540 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-3cd77374-bd1c-41c1-8ead-0136868d0d45 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:31:01.063145 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-3cd77374-bd1c-41c1-8ead-0136868d0d45 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:31:01.203254 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-45d13681-b1d9-42d1-a3a8-47784ebc361f tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:31:01.203977 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-45d13681-b1d9-42d1-a3a8-47784ebc361f tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] [instance: 8558ff08-5004-4dc4-892d-5b6610ce6bec] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:31:01.222800 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-45d13681-b1d9-42d1-a3a8-47784ebc361f tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:31:01.223422 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-45d13681-b1d9-42d1-a3a8-47784ebc361f tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:31:01.224467 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-45d13681-b1d9-42d1-a3a8-47784ebc361f tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:31:01.225001 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-45d13681-b1d9-42d1-a3a8-47784ebc361f tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:31:01.870842 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-3cd77374-bd1c-41c1-8ead-0136868d0d45 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb4dea95659c473b9b193c6234186430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1ca4b83dc874bda9f33e06f4910608c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:31:01.880277 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-3cd77374-bd1c-41c1-8ead-0136868d0d45 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] 10.222.0.46 "GET /compute/v2.1/servers/938a0d12-9045-4220-b0ee-a4ed0a3c4b6a" status: 200 len: 1363 microversion: 2.1 time: 0.836556 Aug 04 05:31:01.899010 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 326/656] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:31:01 2022] GET /compute/v2.1/servers/938a0d12-9045-4220-b0ee-a4ed0a3c4b6a => generated 1363 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:31:01.907308 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-aff4450f-bcfe-4331-8e25-88aa571d405f tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:31:01.908498 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-aff4450f-bcfe-4331-8e25-88aa571d405f tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] [instance: 81874e0c-3350-44a3-8108-be514b727575] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:31:01.917140 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-aff4450f-bcfe-4331-8e25-88aa571d405f tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:31:01.917737 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-aff4450f-bcfe-4331-8e25-88aa571d405f tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:31:01.918634 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-aff4450f-bcfe-4331-8e25-88aa571d405f tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:31:01.919316 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-aff4450f-bcfe-4331-8e25-88aa571d405f tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:31:01.924909 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-45d13681-b1d9-42d1-a3a8-47784ebc361f tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965cf2aad5bc4def9fca55aac87cc37e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32569df1dca45cebcdd63d03ff5abae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:31:01.938331 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-45d13681-b1d9-42d1-a3a8-47784ebc361f tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] 10.222.0.46 "GET /compute/v2.1/servers/8558ff08-5004-4dc4-892d-5b6610ce6bec" status: 200 len: 1576 microversion: 2.1 time: 0.738449 Aug 04 05:31:01.941960 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 331/657] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:31:01 2022] GET /compute/v2.1/servers/8558ff08-5004-4dc4-892d-5b6610ce6bec => generated 1576 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:31:01.957107 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-b9d6caca-2d03-4967-b162-8ad6dff5e108 tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:31:01.958225 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-b9d6caca-2d03-4967-b162-8ad6dff5e108 tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] [instance: 3dfe0046-8259-4d54-9bd3-5031b4eedeb3] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:31:01.972838 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-b9d6caca-2d03-4967-b162-8ad6dff5e108 tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:31:01.973660 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-b9d6caca-2d03-4967-b162-8ad6dff5e108 tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:31:01.974723 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-b9d6caca-2d03-4967-b162-8ad6dff5e108 tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:31:01.978711 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-b9d6caca-2d03-4967-b162-8ad6dff5e108 tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:31:02.407595 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-aff4450f-bcfe-4331-8e25-88aa571d405f tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb49b631c234f9a9fd47049b9b2e097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faead990837d43de8ec54bfaf24361de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:31:02.424187 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-aff4450f-bcfe-4331-8e25-88aa571d405f tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] 10.222.0.46 "GET /compute/v2.1/servers/81874e0c-3350-44a3-8108-be514b727575" status: 200 len: 1366 microversion: 2.1 time: 0.523814 Aug 04 05:31:02.435328 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 327/658] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:31:01 2022] GET /compute/v2.1/servers/81874e0c-3350-44a3-8108-be514b727575 => generated 1366 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:31:02.446147 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [req-6e0c41f9-c954-4806-bdd3-ff32f7e46854 req-917423e7-81f8-495d-ab49-f4e82321363c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3dfe0046-8259-4d54-9bd3-5031b4eedeb3", "tag": "3e30258d-1d58-48d0-ac37-b50de7fc5685"}]} {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:31:02.465612 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [req-6e0c41f9-c954-4806-bdd3-ff32f7e46854 req-917423e7-81f8-495d-ab49-f4e82321363c service nova] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:31:02.466236 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [req-6e0c41f9-c954-4806-bdd3-ff32f7e46854 req-917423e7-81f8-495d-ab49-f4e82321363c service nova] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:31:02.473297 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-b9d6caca-2d03-4967-b162-8ad6dff5e108 tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5af2248451d3483d9742887d614a5077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520d3d5e2e804be1bd5dc9bfc50c5de8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:31:02.490005 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-b9d6caca-2d03-4967-b162-8ad6dff5e108 tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] 10.222.0.46 "GET /compute/v2.1/servers/3dfe0046-8259-4d54-9bd3-5031b4eedeb3" status: 200 len: 1318 microversion: 2.1 time: 0.541795 Aug 04 05:31:02.491431 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 332/659] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:31:01 2022] GET /compute/v2.1/servers/3dfe0046-8259-4d54-9bd3-5031b4eedeb3 => generated 1318 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:31:02.509419 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.compute.server_external_events [req-6e0c41f9-c954-4806-bdd3-ff32f7e46854 req-917423e7-81f8-495d-ab49-f4e82321363c service nova] Creating event network-changed:3e30258d-1d58-48d0-ac37-b50de7fc5685 for instance 3dfe0046-8259-4d54-9bd3-5031b4eedeb3 on hv-cinder-85207 Aug 04 05:31:02.525739 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [req-6e0c41f9-c954-4806-bdd3-ff32f7e46854 req-917423e7-81f8-495d-ab49-f4e82321363c service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088245 Aug 04 05:31:02.526530 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 328/660] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Aug 4 05:31:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:31:02.612587 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [req-e3d16804-2d01-4ad6-b3a5-cf2f34469810 req-9f81bbce-7ca1-4233-8834-c49deb77bbf3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8558ff08-5004-4dc4-892d-5b6610ce6bec", "name": "network-vif-plugged", "status": "completed", "tag": "f7d972aa-2cea-4611-b9c7-a3bf2025197a"}]} {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:31:02.637256 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [req-e3d16804-2d01-4ad6-b3a5-cf2f34469810 req-9f81bbce-7ca1-4233-8834-c49deb77bbf3 service nova] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:31:02.638829 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [req-e3d16804-2d01-4ad6-b3a5-cf2f34469810 req-9f81bbce-7ca1-4233-8834-c49deb77bbf3 service nova] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:31:02.684017 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.compute.server_external_events [req-e3d16804-2d01-4ad6-b3a5-cf2f34469810 req-9f81bbce-7ca1-4233-8834-c49deb77bbf3 service nova] Creating event network-vif-plugged:f7d972aa-2cea-4611-b9c7-a3bf2025197a for instance 8558ff08-5004-4dc4-892d-5b6610ce6bec on hv-cinder-85207 Aug 04 05:31:02.701785 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [req-e3d16804-2d01-4ad6-b3a5-cf2f34469810 req-9f81bbce-7ca1-4233-8834-c49deb77bbf3 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.169601 Aug 04 05:31:02.702480 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 333/661] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Aug 4 05:31:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:31:02.904639 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-d9a6b80e-cceb-49ec-a395-c462babb2ed9 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:31:02.906220 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-d9a6b80e-cceb-49ec-a395-c462babb2ed9 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] [instance: 938a0d12-9045-4220-b0ee-a4ed0a3c4b6a] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:31:02.916238 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-d9a6b80e-cceb-49ec-a395-c462babb2ed9 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:31:02.917547 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-d9a6b80e-cceb-49ec-a395-c462babb2ed9 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:31:02.918514 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-d9a6b80e-cceb-49ec-a395-c462babb2ed9 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:31:02.919598 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-d9a6b80e-cceb-49ec-a395-c462babb2ed9 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:31:02.935933 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG dbcounter [-] [118476] Writing DB stats nova_cell1:SELECT=100 {{(pid=118476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:31:02.967568 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-3ac6a8c6-3920-418a-b483-d4b343021472 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:31:02.969552 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-3ac6a8c6-3920-418a-b483-d4b343021472 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] [instance: 8558ff08-5004-4dc4-892d-5b6610ce6bec] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:31:02.971729 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG dbcounter [-] [118477] Writing DB stats nova_cell0:SELECT=2 {{(pid=118477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:31:02.972402 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG dbcounter [-] [118477] Writing DB stats nova_cell0:SELECT=14 {{(pid=118477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:31:02.982772 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-3ac6a8c6-3920-418a-b483-d4b343021472 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:31:02.983847 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-3ac6a8c6-3920-418a-b483-d4b343021472 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:31:02.985784 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-3ac6a8c6-3920-418a-b483-d4b343021472 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:31:02.985784 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-3ac6a8c6-3920-418a-b483-d4b343021472 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:31:03.217291 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-d9a6b80e-cceb-49ec-a395-c462babb2ed9 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb4dea95659c473b9b193c6234186430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1ca4b83dc874bda9f33e06f4910608c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:31:03.223024 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-3ac6a8c6-3920-418a-b483-d4b343021472 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965cf2aad5bc4def9fca55aac87cc37e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32569df1dca45cebcdd63d03ff5abae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:31:03.224935 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-d9a6b80e-cceb-49ec-a395-c462babb2ed9 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] 10.222.0.46 "GET /compute/v2.1/servers/938a0d12-9045-4220-b0ee-a4ed0a3c4b6a" status: 200 len: 1363 microversion: 2.1 time: 0.327395 Aug 04 05:31:03.234180 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 329/662] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:31:02 2022] GET /compute/v2.1/servers/938a0d12-9045-4220-b0ee-a4ed0a3c4b6a => generated 1363 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:31:03.234180 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [req-97d327cc-37e1-4cf8-905a-5fc506992965 req-1e241c3d-2e7f-4781-9afd-f198675b5635 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "81874e0c-3350-44a3-8108-be514b727575", "tag": "2bdd1a30-d52a-4486-a7b1-3ca17440e0a8"}]} {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:31:03.234668 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-3ac6a8c6-3920-418a-b483-d4b343021472 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] 10.222.0.46 "GET /compute/v2.1/servers/8558ff08-5004-4dc4-892d-5b6610ce6bec" status: 200 len: 1576 microversion: 2.1 time: 0.269863 Aug 04 05:31:03.234668 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 334/663] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:31:02 2022] GET /compute/v2.1/servers/8558ff08-5004-4dc4-892d-5b6610ce6bec => generated 1576 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:31:03.258816 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [req-97d327cc-37e1-4cf8-905a-5fc506992965 req-1e241c3d-2e7f-4781-9afd-f198675b5635 service nova] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:31:03.259351 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [req-97d327cc-37e1-4cf8-905a-5fc506992965 req-1e241c3d-2e7f-4781-9afd-f198675b5635 service nova] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:31:03.273327 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.compute.server_external_events [req-97d327cc-37e1-4cf8-905a-5fc506992965 req-1e241c3d-2e7f-4781-9afd-f198675b5635 service nova] Creating event network-changed:2bdd1a30-d52a-4486-a7b1-3ca17440e0a8 for instance 81874e0c-3350-44a3-8108-be514b727575 on hv-cinder-85207 Aug 04 05:31:03.278975 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [req-97d327cc-37e1-4cf8-905a-5fc506992965 req-1e241c3d-2e7f-4781-9afd-f198675b5635 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051018 Aug 04 05:31:03.279701 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 330/664] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Aug 4 05:31:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:31:03.445716 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-1ebadffd-efd9-401e-bf64-de737c8a139f tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:31:03.446234 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-1ebadffd-efd9-401e-bf64-de737c8a139f tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] [instance: 81874e0c-3350-44a3-8108-be514b727575] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:31:03.452807 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-1ebadffd-efd9-401e-bf64-de737c8a139f tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:31:03.453289 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-1ebadffd-efd9-401e-bf64-de737c8a139f tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:31:03.454070 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-1ebadffd-efd9-401e-bf64-de737c8a139f tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:31:03.454780 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-1ebadffd-efd9-401e-bf64-de737c8a139f tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:31:03.517133 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-cf326124-d835-4166-a6a8-ca0830592ad2 tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:31:03.523450 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-cf326124-d835-4166-a6a8-ca0830592ad2 tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] [instance: 3dfe0046-8259-4d54-9bd3-5031b4eedeb3] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:31:03.525714 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-cf326124-d835-4166-a6a8-ca0830592ad2 tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:31:03.526440 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-cf326124-d835-4166-a6a8-ca0830592ad2 tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:31:03.527404 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-cf326124-d835-4166-a6a8-ca0830592ad2 tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:31:03.528142 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-cf326124-d835-4166-a6a8-ca0830592ad2 tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:31:03.802134 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-1ebadffd-efd9-401e-bf64-de737c8a139f tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb49b631c234f9a9fd47049b9b2e097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faead990837d43de8ec54bfaf24361de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:31:03.811536 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-1ebadffd-efd9-401e-bf64-de737c8a139f tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] 10.222.0.46 "GET /compute/v2.1/servers/81874e0c-3350-44a3-8108-be514b727575" status: 200 len: 1366 microversion: 2.1 time: 0.370293 Aug 04 05:31:03.812139 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 335/665] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:31:03 2022] GET /compute/v2.1/servers/81874e0c-3350-44a3-8108-be514b727575 => generated 1366 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:31:03.862374 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-cf326124-d835-4166-a6a8-ca0830592ad2 tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5af2248451d3483d9742887d614a5077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520d3d5e2e804be1bd5dc9bfc50c5de8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:31:03.871167 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-cf326124-d835-4166-a6a8-ca0830592ad2 tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] 10.222.0.46 "GET /compute/v2.1/servers/3dfe0046-8259-4d54-9bd3-5031b4eedeb3" status: 200 len: 1318 microversion: 2.1 time: 0.358198 Aug 04 05:31:03.871764 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 331/666] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:31:03 2022] GET /compute/v2.1/servers/3dfe0046-8259-4d54-9bd3-5031b4eedeb3 => generated 1318 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:31:03.893156 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-7bd16313-9d03-423d-bdba-6473bd140e54 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1912506543", "imageRef": "4613f7d0-37ca-46ad-bb26-dc4990dd7d6f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e4a59e7d-a01a-4b8d-82ee-61f087655ac3"}], "security_groups": [{"name": "tempest-securitygroup--1113855793"}], "key_name": "tempest-keypair-805187364", "user_data": "}} {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:31:04.007247 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.network.neutron [None req-7bd16313-9d03-423d-bdba-6473bd140e54 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] validate_networks() for [('e4a59e7d-a01a-4b8d-82ee-61f087655ac3', None, None, None, None, None)] {{(pid=118477) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 05:31:04.246968 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-39e6adc9-80ec-4768-a6b5-1d1d72136e7a tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:31:04.247633 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-39e6adc9-80ec-4768-a6b5-1d1d72136e7a tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] [instance: 938a0d12-9045-4220-b0ee-a4ed0a3c4b6a] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:31:04.253701 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-39e6adc9-80ec-4768-a6b5-1d1d72136e7a tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:31:04.254150 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-39e6adc9-80ec-4768-a6b5-1d1d72136e7a tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:31:04.254951 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-39e6adc9-80ec-4768-a6b5-1d1d72136e7a tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:31:04.255393 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-39e6adc9-80ec-4768-a6b5-1d1d72136e7a tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:31:04.528508 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.virt.hardware [None req-7bd16313-9d03-423d-bdba-6473bd140e54 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Flavor limits 0:0:0 {{(pid=118477) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 05:31:04.528931 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.virt.hardware [None req-7bd16313-9d03-423d-bdba-6473bd140e54 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Image limits 0:0:0 {{(pid=118477) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 05:31:04.529398 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.virt.hardware [None req-7bd16313-9d03-423d-bdba-6473bd140e54 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Flavor pref 0:0:0 {{(pid=118477) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 05:31:04.530542 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.virt.hardware [None req-7bd16313-9d03-423d-bdba-6473bd140e54 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Image pref 0:0:0 {{(pid=118477) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 05:31:04.530643 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.virt.hardware [None req-7bd16313-9d03-423d-bdba-6473bd140e54 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118477) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 05:31:04.533650 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-39e6adc9-80ec-4768-a6b5-1d1d72136e7a tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb4dea95659c473b9b193c6234186430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1ca4b83dc874bda9f33e06f4910608c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:31:04.540553 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-7bd16313-9d03-423d-bdba-6473bd140e54 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:31:04.540987 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-7bd16313-9d03-423d-bdba-6473bd140e54 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:31:04.541806 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-7bd16313-9d03-423d-bdba-6473bd140e54 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:31:04.542057 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-39e6adc9-80ec-4768-a6b5-1d1d72136e7a tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] 10.222.0.46 "GET /compute/v2.1/servers/938a0d12-9045-4220-b0ee-a4ed0a3c4b6a" status: 200 len: 1363 microversion: 2.1 time: 0.298939 Aug 04 05:31:04.544915 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-7bd16313-9d03-423d-bdba-6473bd140e54 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:31:04.545022 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 332/667] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:31:04 2022] GET /compute/v2.1/servers/938a0d12-9045-4220-b0ee-a4ed0a3c4b6a => generated 1363 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 05:31:04.547245 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-c90455aa-431f-42b0-a8f2-5e5f251a998d tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:31:04.548038 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-c90455aa-431f-42b0-a8f2-5e5f251a998d tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] [instance: 8558ff08-5004-4dc4-892d-5b6610ce6bec] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:31:04.553908 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-c90455aa-431f-42b0-a8f2-5e5f251a998d tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:31:04.554479 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-c90455aa-431f-42b0-a8f2-5e5f251a998d tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:31:04.555315 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-c90455aa-431f-42b0-a8f2-5e5f251a998d tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:31:04.555834 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-c90455aa-431f-42b0-a8f2-5e5f251a998d tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:31:04.561907 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.quota [None req-7bd16313-9d03-423d-bdba-6473bd140e54 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Getting quotas for project 290c5e886bf64e989f2be4b94a570e3f. Resources: {'instances', 'cores', 'ram'} {{(pid=118477) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 05:31:04.565940 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.quota [None req-7bd16313-9d03-423d-bdba-6473bd140e54 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Getting quotas for user fd2797b8820c41a2ae939fd7c473a549 and project 290c5e886bf64e989f2be4b94a570e3f. Resources: {'instances', 'cores', 'ram'} {{(pid=118477) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 05:31:04.577885 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-7bd16313-9d03-423d-bdba-6473bd140e54 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Going to run 1 instances... {{(pid=118477) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 05:31:04.580431 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-7bd16313-9d03-423d-bdba-6473bd140e54 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] [instance: 2e3bce83-6dff-479d-a54c-8f660fbbcdc5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4613f7d0-37ca-46ad-bb26-dc4990dd7d6f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118477) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 05:31:04.691185 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-c90455aa-431f-42b0-a8f2-5e5f251a998d tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965cf2aad5bc4def9fca55aac87cc37e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32569df1dca45cebcdd63d03ff5abae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:31:04.700157 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-c90455aa-431f-42b0-a8f2-5e5f251a998d tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] 10.222.0.46 "GET /compute/v2.1/servers/8558ff08-5004-4dc4-892d-5b6610ce6bec" status: 200 len: 1576 microversion: 2.1 time: 0.156508 Aug 04 05:31:04.700817 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 333/668] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:31:04 2022] GET /compute/v2.1/servers/8558ff08-5004-4dc4-892d-5b6610ce6bec => generated 1576 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:31:04.707766 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-7bd16313-9d03-423d-bdba-6473bd140e54 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.819174 Aug 04 05:31:04.708603 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 336/669] 10.222.0.46 () {62 vars in 1188 bytes} [Thu Aug 4 05:31:03 2022] POST /compute/v2.1/servers => generated 402 bytes in 821 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 04 05:31:04.721138 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-ebe8bf4f-192b-4573-a5ba-f92f026b389b tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:31:04.721795 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-ebe8bf4f-192b-4573-a5ba-f92f026b389b tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] [instance: 2e3bce83-6dff-479d-a54c-8f660fbbcdc5] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:31:04.779153 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-ebe8bf4f-192b-4573-a5ba-f92f026b389b tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:31:04.786992 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-ebe8bf4f-192b-4573-a5ba-f92f026b389b tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:31:04.788742 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-ebe8bf4f-192b-4573-a5ba-f92f026b389b tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:31:04.789872 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-ebe8bf4f-192b-4573-a5ba-f92f026b389b tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] 10.222.0.46 "GET /compute/v2.1/servers/2e3bce83-6dff-479d-a54c-8f660fbbcdc5" status: 200 len: 1281 microversion: 2.20 time: 0.072695 Aug 04 05:31:04.790458 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 334/670] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Aug 4 05:31:04 2022] GET /compute/v2.1/servers/2e3bce83-6dff-479d-a54c-8f660fbbcdc5 => generated 1281 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 05:31:04.833190 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-aefadab3-42c6-4966-8296-81c029c61c38 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:31:04.833965 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-aefadab3-42c6-4966-8296-81c029c61c38 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] [instance: 81874e0c-3350-44a3-8108-be514b727575] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:31:04.842572 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-aefadab3-42c6-4966-8296-81c029c61c38 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:31:04.843028 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-aefadab3-42c6-4966-8296-81c029c61c38 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:31:04.843799 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-aefadab3-42c6-4966-8296-81c029c61c38 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:31:04.844264 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-aefadab3-42c6-4966-8296-81c029c61c38 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:31:04.893224 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-2a42137c-9a3c-4d2a-bcee-d4474120aa5a tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:31:04.893867 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-2a42137c-9a3c-4d2a-bcee-d4474120aa5a tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] [instance: 3dfe0046-8259-4d54-9bd3-5031b4eedeb3] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:31:04.901322 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-2a42137c-9a3c-4d2a-bcee-d4474120aa5a tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:31:04.901769 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-2a42137c-9a3c-4d2a-bcee-d4474120aa5a tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:31:04.902561 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-2a42137c-9a3c-4d2a-bcee-d4474120aa5a tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:31:04.903003 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-2a42137c-9a3c-4d2a-bcee-d4474120aa5a tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:31:05.035089 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-aefadab3-42c6-4966-8296-81c029c61c38 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb49b631c234f9a9fd47049b9b2e097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faead990837d43de8ec54bfaf24361de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:31:05.043295 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-aefadab3-42c6-4966-8296-81c029c61c38 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] 10.222.0.46 "GET /compute/v2.1/servers/81874e0c-3350-44a3-8108-be514b727575" status: 200 len: 1366 microversion: 2.1 time: 0.213914 Aug 04 05:31:05.043888 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 337/671] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:31:04 2022] GET /compute/v2.1/servers/81874e0c-3350-44a3-8108-be514b727575 => generated 1366 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:31:05.073852 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-2a42137c-9a3c-4d2a-bcee-d4474120aa5a tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5af2248451d3483d9742887d614a5077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520d3d5e2e804be1bd5dc9bfc50c5de8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:31:05.083027 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-2a42137c-9a3c-4d2a-bcee-d4474120aa5a tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] 10.222.0.46 "GET /compute/v2.1/servers/3dfe0046-8259-4d54-9bd3-5031b4eedeb3" status: 200 len: 1318 microversion: 2.1 time: 0.193422 Aug 04 05:31:05.083724 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 335/672] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:31:04 2022] GET /compute/v2.1/servers/3dfe0046-8259-4d54-9bd3-5031b4eedeb3 => generated 1318 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:31:05.562877 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-0861f665-5a26-4b44-970e-f8df71627db5 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:31:05.563403 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-0861f665-5a26-4b44-970e-f8df71627db5 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] [instance: 938a0d12-9045-4220-b0ee-a4ed0a3c4b6a] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:31:05.570597 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-0861f665-5a26-4b44-970e-f8df71627db5 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:31:05.571055 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-0861f665-5a26-4b44-970e-f8df71627db5 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:31:05.571804 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-0861f665-5a26-4b44-970e-f8df71627db5 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:31:05.572331 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-0861f665-5a26-4b44-970e-f8df71627db5 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:31:05.721486 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-1aafc417-7f73-4b63-a861-e48b0d751613 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:31:05.722168 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-1aafc417-7f73-4b63-a861-e48b0d751613 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] [instance: 8558ff08-5004-4dc4-892d-5b6610ce6bec] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:31:05.729125 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-1aafc417-7f73-4b63-a861-e48b0d751613 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:31:05.729668 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-1aafc417-7f73-4b63-a861-e48b0d751613 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:31:05.730473 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-1aafc417-7f73-4b63-a861-e48b0d751613 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:31:05.730912 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-1aafc417-7f73-4b63-a861-e48b0d751613 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:31:05.760736 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-0861f665-5a26-4b44-970e-f8df71627db5 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb4dea95659c473b9b193c6234186430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1ca4b83dc874bda9f33e06f4910608c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:31:05.768400 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-0861f665-5a26-4b44-970e-f8df71627db5 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] 10.222.0.46 "GET /compute/v2.1/servers/938a0d12-9045-4220-b0ee-a4ed0a3c4b6a" status: 200 len: 1363 microversion: 2.1 time: 0.209419 Aug 04 05:31:05.768969 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 338/673] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:31:05 2022] GET /compute/v2.1/servers/938a0d12-9045-4220-b0ee-a4ed0a3c4b6a => generated 1363 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:31:05.812585 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-2d6615ac-87b0-4814-9a5d-23ab5fca5d5d tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:31:05.813057 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-2d6615ac-87b0-4814-9a5d-23ab5fca5d5d tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] [instance: 2e3bce83-6dff-479d-a54c-8f660fbbcdc5] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:31:05.871469 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-2d6615ac-87b0-4814-9a5d-23ab5fca5d5d tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:31:05.878757 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-2d6615ac-87b0-4814-9a5d-23ab5fca5d5d tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:31:05.880271 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-2d6615ac-87b0-4814-9a5d-23ab5fca5d5d tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:31:05.881365 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-2d6615ac-87b0-4814-9a5d-23ab5fca5d5d tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] 10.222.0.46 "GET /compute/v2.1/servers/2e3bce83-6dff-479d-a54c-8f660fbbcdc5" status: 200 len: 1281 microversion: 2.20 time: 0.072957 Aug 04 05:31:05.882692 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 339/674] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Aug 4 05:31:05 2022] GET /compute/v2.1/servers/2e3bce83-6dff-479d-a54c-8f660fbbcdc5 => generated 1281 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 05:31:05.897798 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-1aafc417-7f73-4b63-a861-e48b0d751613 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965cf2aad5bc4def9fca55aac87cc37e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32569df1dca45cebcdd63d03ff5abae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:31:05.905976 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-1aafc417-7f73-4b63-a861-e48b0d751613 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] 10.222.0.46 "GET /compute/v2.1/servers/8558ff08-5004-4dc4-892d-5b6610ce6bec" status: 200 len: 1576 microversion: 2.1 time: 0.188683 Aug 04 05:31:05.910534 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 336/675] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:31:05 2022] GET /compute/v2.1/servers/8558ff08-5004-4dc4-892d-5b6610ce6bec => generated 1576 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 05:31:06.065951 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-d2094087-3764-4f32-902f-34f59118f300 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:31:06.066519 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-d2094087-3764-4f32-902f-34f59118f300 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] [instance: 81874e0c-3350-44a3-8108-be514b727575] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:31:06.073101 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-d2094087-3764-4f32-902f-34f59118f300 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:31:06.074095 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-d2094087-3764-4f32-902f-34f59118f300 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:31:06.074655 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-d2094087-3764-4f32-902f-34f59118f300 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:31:06.075085 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-d2094087-3764-4f32-902f-34f59118f300 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:31:06.105164 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-3a97a8b3-eca2-48af-82bc-667af45d4c3b tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:31:06.112971 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-3a97a8b3-eca2-48af-82bc-667af45d4c3b tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] [instance: 3dfe0046-8259-4d54-9bd3-5031b4eedeb3] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:31:06.112971 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-3a97a8b3-eca2-48af-82bc-667af45d4c3b tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:31:06.112971 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-3a97a8b3-eca2-48af-82bc-667af45d4c3b tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:31:06.113318 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-3a97a8b3-eca2-48af-82bc-667af45d4c3b tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:31:06.113512 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-3a97a8b3-eca2-48af-82bc-667af45d4c3b tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:31:06.353270 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-d2094087-3764-4f32-902f-34f59118f300 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb49b631c234f9a9fd47049b9b2e097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faead990837d43de8ec54bfaf24361de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:31:06.363108 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-d2094087-3764-4f32-902f-34f59118f300 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] 10.222.0.46 "GET /compute/v2.1/servers/81874e0c-3350-44a3-8108-be514b727575" status: 200 len: 1366 microversion: 2.1 time: 0.301624 Aug 04 05:31:06.364357 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 340/676] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:31:06 2022] GET /compute/v2.1/servers/81874e0c-3350-44a3-8108-be514b727575 => generated 1366 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:31:06.373590 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-3a97a8b3-eca2-48af-82bc-667af45d4c3b tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5af2248451d3483d9742887d614a5077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520d3d5e2e804be1bd5dc9bfc50c5de8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:31:06.382680 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-3a97a8b3-eca2-48af-82bc-667af45d4c3b tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] 10.222.0.46 "GET /compute/v2.1/servers/3dfe0046-8259-4d54-9bd3-5031b4eedeb3" status: 200 len: 1318 microversion: 2.1 time: 0.282068 Aug 04 05:31:06.385739 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 337/677] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:31:06 2022] GET /compute/v2.1/servers/3dfe0046-8259-4d54-9bd3-5031b4eedeb3 => generated 1318 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 05:31:06.791722 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-f28713b3-30b4-4efc-94e4-07701419cd1a tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:31:06.792355 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-f28713b3-30b4-4efc-94e4-07701419cd1a tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] [instance: 938a0d12-9045-4220-b0ee-a4ed0a3c4b6a] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:31:06.800757 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-f28713b3-30b4-4efc-94e4-07701419cd1a tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:31:06.801012 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-f28713b3-30b4-4efc-94e4-07701419cd1a tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:31:06.801774 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-f28713b3-30b4-4efc-94e4-07701419cd1a tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:31:06.802205 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-f28713b3-30b4-4efc-94e4-07701419cd1a tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:31:06.905200 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-c0b5e93b-379e-4d8f-98c7-06f5b044e407 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:31:06.906891 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-c0b5e93b-379e-4d8f-98c7-06f5b044e407 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] [instance: 2e3bce83-6dff-479d-a54c-8f660fbbcdc5] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:31:06.909076 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG dbcounter [-] [118476] Writing DB stats nova_cell0:SELECT=4 {{(pid=118476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:31:06.915360 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-c0b5e93b-379e-4d8f-98c7-06f5b044e407 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:31:06.915981 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-c0b5e93b-379e-4d8f-98c7-06f5b044e407 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:31:06.917334 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-c0b5e93b-379e-4d8f-98c7-06f5b044e407 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:31:06.917889 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-c0b5e93b-379e-4d8f-98c7-06f5b044e407 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:31:06.950906 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-f28713b3-30b4-4efc-94e4-07701419cd1a tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb4dea95659c473b9b193c6234186430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1ca4b83dc874bda9f33e06f4910608c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:31:06.958835 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-f28713b3-30b4-4efc-94e4-07701419cd1a tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] 10.222.0.46 "GET /compute/v2.1/servers/938a0d12-9045-4220-b0ee-a4ed0a3c4b6a" status: 200 len: 1363 microversion: 2.1 time: 0.172311 Aug 04 05:31:06.960431 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 341/678] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:31:06 2022] GET /compute/v2.1/servers/938a0d12-9045-4220-b0ee-a4ed0a3c4b6a => generated 1363 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 05:31:06.965184 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-36d239ae-23a9-47a4-9870-bb3b7689267b tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:31:06.968272 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-36d239ae-23a9-47a4-9870-bb3b7689267b tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] [instance: 8558ff08-5004-4dc4-892d-5b6610ce6bec] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:31:06.972335 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-36d239ae-23a9-47a4-9870-bb3b7689267b tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:31:06.972846 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-36d239ae-23a9-47a4-9870-bb3b7689267b tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:31:06.973613 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-36d239ae-23a9-47a4-9870-bb3b7689267b tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:31:06.974148 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-36d239ae-23a9-47a4-9870-bb3b7689267b tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:31:06.989771 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-c0b5e93b-379e-4d8f-98c7-06f5b044e407 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:31:06.990045 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG dbcounter [-] [118477] Writing DB stats nova_cell1:SELECT=100 {{(pid=118477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:31:06.998607 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-c0b5e93b-379e-4d8f-98c7-06f5b044e407 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:31:07.000110 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-c0b5e93b-379e-4d8f-98c7-06f5b044e407 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:31:07.001330 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-c0b5e93b-379e-4d8f-98c7-06f5b044e407 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] 10.222.0.46 "GET /compute/v2.1/servers/2e3bce83-6dff-479d-a54c-8f660fbbcdc5" status: 200 len: 1277 microversion: 2.20 time: 0.100313 Aug 04 05:31:07.001893 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 338/679] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Aug 4 05:31:06 2022] GET /compute/v2.1/servers/2e3bce83-6dff-479d-a54c-8f660fbbcdc5 => generated 1277 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 05:31:07.121871 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-36d239ae-23a9-47a4-9870-bb3b7689267b tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965cf2aad5bc4def9fca55aac87cc37e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32569df1dca45cebcdd63d03ff5abae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:31:07.129449 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-36d239ae-23a9-47a4-9870-bb3b7689267b tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] 10.222.0.46 "GET /compute/v2.1/servers/8558ff08-5004-4dc4-892d-5b6610ce6bec" status: 200 len: 1563 microversion: 2.1 time: 0.168065 Aug 04 05:31:07.130017 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 342/680] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:31:06 2022] GET /compute/v2.1/servers/8558ff08-5004-4dc4-892d-5b6610ce6bec => generated 1563 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:31:07.390258 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-0d0f7fe7-2c15-4822-9a88-561248cb7f94 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:31:07.391182 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-0d0f7fe7-2c15-4822-9a88-561248cb7f94 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] [instance: 81874e0c-3350-44a3-8108-be514b727575] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:31:07.399445 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-0d0f7fe7-2c15-4822-9a88-561248cb7f94 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:31:07.399887 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-0d0f7fe7-2c15-4822-9a88-561248cb7f94 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:31:07.400693 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-0d0f7fe7-2c15-4822-9a88-561248cb7f94 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:31:07.401140 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-0d0f7fe7-2c15-4822-9a88-561248cb7f94 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:31:07.406584 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-629c0a91-25f3-4c87-8574-0246429f54fd tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:31:07.407493 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-629c0a91-25f3-4c87-8574-0246429f54fd tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] [instance: 3dfe0046-8259-4d54-9bd3-5031b4eedeb3] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:31:07.415309 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-629c0a91-25f3-4c87-8574-0246429f54fd tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:31:07.416156 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-629c0a91-25f3-4c87-8574-0246429f54fd tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:31:07.416980 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-629c0a91-25f3-4c87-8574-0246429f54fd tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:31:07.417409 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-629c0a91-25f3-4c87-8574-0246429f54fd tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:31:07.690246 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-0d0f7fe7-2c15-4822-9a88-561248cb7f94 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb49b631c234f9a9fd47049b9b2e097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faead990837d43de8ec54bfaf24361de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:31:07.700076 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-0d0f7fe7-2c15-4822-9a88-561248cb7f94 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] 10.222.0.46 "GET /compute/v2.1/servers/81874e0c-3350-44a3-8108-be514b727575" status: 200 len: 1366 microversion: 2.1 time: 0.314030 Aug 04 05:31:07.700882 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 339/681] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:31:07 2022] GET /compute/v2.1/servers/81874e0c-3350-44a3-8108-be514b727575 => generated 1366 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:31:07.709005 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-629c0a91-25f3-4c87-8574-0246429f54fd tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5af2248451d3483d9742887d614a5077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520d3d5e2e804be1bd5dc9bfc50c5de8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:31:07.720979 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-629c0a91-25f3-4c87-8574-0246429f54fd tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] 10.222.0.46 "GET /compute/v2.1/servers/3dfe0046-8259-4d54-9bd3-5031b4eedeb3" status: 200 len: 1318 microversion: 2.1 time: 0.319467 Aug 04 05:31:07.730801 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 343/682] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:31:07 2022] GET /compute/v2.1/servers/3dfe0046-8259-4d54-9bd3-5031b4eedeb3 => generated 1318 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:31:07.985963 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-2afe595d-6cb6-42c8-af4f-39c965419d03 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:31:07.985963 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-2afe595d-6cb6-42c8-af4f-39c965419d03 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] [instance: 938a0d12-9045-4220-b0ee-a4ed0a3c4b6a] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:31:07.988421 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-2afe595d-6cb6-42c8-af4f-39c965419d03 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:31:07.988868 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-2afe595d-6cb6-42c8-af4f-39c965419d03 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:31:07.989626 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-2afe595d-6cb6-42c8-af4f-39c965419d03 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:31:07.990057 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-2afe595d-6cb6-42c8-af4f-39c965419d03 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:31:08.028445 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-b0e962cc-6681-430a-8a15-76975ea5c01e tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:31:08.029134 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-b0e962cc-6681-430a-8a15-76975ea5c01e tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] [instance: 2e3bce83-6dff-479d-a54c-8f660fbbcdc5] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:31:08.036159 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-b0e962cc-6681-430a-8a15-76975ea5c01e tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:31:08.036600 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-b0e962cc-6681-430a-8a15-76975ea5c01e tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:31:08.037362 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-b0e962cc-6681-430a-8a15-76975ea5c01e tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:31:08.038548 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-b0e962cc-6681-430a-8a15-76975ea5c01e tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:31:08.124981 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-b0e962cc-6681-430a-8a15-76975ea5c01e tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:31:08.134569 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-b0e962cc-6681-430a-8a15-76975ea5c01e tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:31:08.135478 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-b0e962cc-6681-430a-8a15-76975ea5c01e tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:31:08.136620 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-b0e962cc-6681-430a-8a15-76975ea5c01e tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] 10.222.0.46 "GET /compute/v2.1/servers/2e3bce83-6dff-479d-a54c-8f660fbbcdc5" status: 200 len: 1339 microversion: 2.20 time: 0.112226 Aug 04 05:31:08.137419 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 344/683] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Aug 4 05:31:08 2022] GET /compute/v2.1/servers/2e3bce83-6dff-479d-a54c-8f660fbbcdc5 => generated 1339 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 05:31:08.477141 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-2afe595d-6cb6-42c8-af4f-39c965419d03 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb4dea95659c473b9b193c6234186430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1ca4b83dc874bda9f33e06f4910608c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:31:08.484681 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-2afe595d-6cb6-42c8-af4f-39c965419d03 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] 10.222.0.46 "GET /compute/v2.1/servers/938a0d12-9045-4220-b0ee-a4ed0a3c4b6a" status: 200 len: 1363 microversion: 2.1 time: 0.507047 Aug 04 05:31:08.485261 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 340/684] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:31:07 2022] GET /compute/v2.1/servers/938a0d12-9045-4220-b0ee-a4ed0a3c4b6a => generated 1363 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:31:08.722582 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-4f620c52-3932-4485-889a-a0f31087f4d0 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:31:08.723629 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-4f620c52-3932-4485-889a-a0f31087f4d0 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] [instance: 81874e0c-3350-44a3-8108-be514b727575] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:31:08.732535 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-4f620c52-3932-4485-889a-a0f31087f4d0 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:31:08.733412 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-4f620c52-3932-4485-889a-a0f31087f4d0 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:31:08.734542 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-4f620c52-3932-4485-889a-a0f31087f4d0 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:31:08.736306 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-4f620c52-3932-4485-889a-a0f31087f4d0 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:31:08.748479 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-4f6ca213-c0cf-4342-8b6d-9201d3124e49 tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:31:08.749277 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-4f6ca213-c0cf-4342-8b6d-9201d3124e49 tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] [instance: 3dfe0046-8259-4d54-9bd3-5031b4eedeb3] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:31:08.762063 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-4f6ca213-c0cf-4342-8b6d-9201d3124e49 tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:31:08.763382 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-4f6ca213-c0cf-4342-8b6d-9201d3124e49 tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:31:08.770534 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-4f6ca213-c0cf-4342-8b6d-9201d3124e49 tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:31:08.770534 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-4f6ca213-c0cf-4342-8b6d-9201d3124e49 tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:31:09.043645 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-4f620c52-3932-4485-889a-a0f31087f4d0 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb49b631c234f9a9fd47049b9b2e097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faead990837d43de8ec54bfaf24361de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:31:09.052429 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-4f620c52-3932-4485-889a-a0f31087f4d0 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] 10.222.0.46 "GET /compute/v2.1/servers/81874e0c-3350-44a3-8108-be514b727575" status: 200 len: 1366 microversion: 2.1 time: 0.334231 Aug 04 05:31:09.053599 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 345/685] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:31:08 2022] GET /compute/v2.1/servers/81874e0c-3350-44a3-8108-be514b727575 => generated 1366 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:31:09.055397 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-4f6ca213-c0cf-4342-8b6d-9201d3124e49 tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5af2248451d3483d9742887d614a5077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520d3d5e2e804be1bd5dc9bfc50c5de8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:31:09.070510 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-4f6ca213-c0cf-4342-8b6d-9201d3124e49 tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] 10.222.0.46 "GET /compute/v2.1/servers/3dfe0046-8259-4d54-9bd3-5031b4eedeb3" status: 200 len: 1318 microversion: 2.1 time: 0.323251 Aug 04 05:31:09.072072 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 341/686] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:31:08 2022] GET /compute/v2.1/servers/3dfe0046-8259-4d54-9bd3-5031b4eedeb3 => generated 1318 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 05:31:09.073513 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [req-a4ca1454-9c2c-47d6-aff9-d961debba2df req-4bad4466-b318-44ad-88b7-11afea3a59a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3dfe0046-8259-4d54-9bd3-5031b4eedeb3", "name": "network-vif-plugged", "status": "completed", "tag": "3e30258d-1d58-48d0-ac37-b50de7fc5685"}]} {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:31:09.086049 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [req-a4ca1454-9c2c-47d6-aff9-d961debba2df req-4bad4466-b318-44ad-88b7-11afea3a59a0 service nova] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:31:09.087065 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [req-a4ca1454-9c2c-47d6-aff9-d961debba2df req-4bad4466-b318-44ad-88b7-11afea3a59a0 service nova] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:31:09.098953 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.compute.server_external_events [req-a4ca1454-9c2c-47d6-aff9-d961debba2df req-4bad4466-b318-44ad-88b7-11afea3a59a0 service nova] Creating event network-vif-plugged:3e30258d-1d58-48d0-ac37-b50de7fc5685 for instance 3dfe0046-8259-4d54-9bd3-5031b4eedeb3 on hv-cinder-85207 Aug 04 05:31:09.104872 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [req-a4ca1454-9c2c-47d6-aff9-d961debba2df req-4bad4466-b318-44ad-88b7-11afea3a59a0 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036065 Aug 04 05:31:09.105816 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 346/687] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Aug 4 05:31:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:31:09.165143 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-21c53b64-606a-4371-9191-b4d31151198d tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:31:09.166908 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-21c53b64-606a-4371-9191-b4d31151198d tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] [instance: 2e3bce83-6dff-479d-a54c-8f660fbbcdc5] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:31:09.174565 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-21c53b64-606a-4371-9191-b4d31151198d tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:31:09.175284 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-21c53b64-606a-4371-9191-b4d31151198d tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:31:09.176280 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-21c53b64-606a-4371-9191-b4d31151198d tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:31:09.177476 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-21c53b64-606a-4371-9191-b4d31151198d tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:31:09.409244 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-21c53b64-606a-4371-9191-b4d31151198d tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:31:09.418716 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-21c53b64-606a-4371-9191-b4d31151198d tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:31:09.420328 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-21c53b64-606a-4371-9191-b4d31151198d tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:31:09.421429 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-21c53b64-606a-4371-9191-b4d31151198d tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] 10.222.0.46 "GET /compute/v2.1/servers/2e3bce83-6dff-479d-a54c-8f660fbbcdc5" status: 200 len: 1407 microversion: 2.20 time: 0.262945 Aug 04 05:31:09.421988 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 342/688] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Aug 4 05:31:09 2022] GET /compute/v2.1/servers/2e3bce83-6dff-479d-a54c-8f660fbbcdc5 => generated 1407 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 05:31:09.509227 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-3d940f0f-31f1-4ecb-915a-83f0abe25ebd tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:31:09.512246 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-3d940f0f-31f1-4ecb-915a-83f0abe25ebd tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] [instance: 938a0d12-9045-4220-b0ee-a4ed0a3c4b6a] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:31:09.518916 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-3d940f0f-31f1-4ecb-915a-83f0abe25ebd tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:31:09.519355 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-3d940f0f-31f1-4ecb-915a-83f0abe25ebd tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:31:09.520300 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-3d940f0f-31f1-4ecb-915a-83f0abe25ebd tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:31:09.520897 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-3d940f0f-31f1-4ecb-915a-83f0abe25ebd tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:31:09.790738 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-3d940f0f-31f1-4ecb-915a-83f0abe25ebd tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb4dea95659c473b9b193c6234186430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1ca4b83dc874bda9f33e06f4910608c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:31:09.798456 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-3d940f0f-31f1-4ecb-915a-83f0abe25ebd tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] 10.222.0.46 "GET /compute/v2.1/servers/938a0d12-9045-4220-b0ee-a4ed0a3c4b6a" status: 200 len: 1363 microversion: 2.1 time: 0.295246 Aug 04 05:31:09.799507 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 347/689] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:31:09 2022] GET /compute/v2.1/servers/938a0d12-9045-4220-b0ee-a4ed0a3c4b6a => generated 1363 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:31:09.965133 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [req-bf323c9b-67f4-4a1f-a14f-51ebff4a5ec6 req-f78452b4-2e92-4d31-833e-bacf37e1444b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2e3bce83-6dff-479d-a54c-8f660fbbcdc5", "tag": "ddeaefd6-9468-4764-8ef0-df45fd5ea8db"}]} {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:31:09.974782 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [req-bf323c9b-67f4-4a1f-a14f-51ebff4a5ec6 req-f78452b4-2e92-4d31-833e-bacf37e1444b service nova] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:31:09.975869 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [req-bf323c9b-67f4-4a1f-a14f-51ebff4a5ec6 req-f78452b4-2e92-4d31-833e-bacf37e1444b service nova] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:31:09.986930 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.compute.server_external_events [req-bf323c9b-67f4-4a1f-a14f-51ebff4a5ec6 req-f78452b4-2e92-4d31-833e-bacf37e1444b service nova] Creating event network-changed:ddeaefd6-9468-4764-8ef0-df45fd5ea8db for instance 2e3bce83-6dff-479d-a54c-8f660fbbcdc5 on hv-cinder-85207 Aug 04 05:31:09.992292 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [req-bf323c9b-67f4-4a1f-a14f-51ebff4a5ec6 req-f78452b4-2e92-4d31-833e-bacf37e1444b service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030620 Aug 04 05:31:09.992961 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 343/690] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Aug 4 05:31:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:31:10.076119 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-8e937019-8fb7-4524-a70f-477b84990e07 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:31:10.076728 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-8e937019-8fb7-4524-a70f-477b84990e07 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] [instance: 81874e0c-3350-44a3-8108-be514b727575] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:31:10.083289 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-8e937019-8fb7-4524-a70f-477b84990e07 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:31:10.083735 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-8e937019-8fb7-4524-a70f-477b84990e07 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:31:10.084605 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-8e937019-8fb7-4524-a70f-477b84990e07 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:31:10.085071 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-8e937019-8fb7-4524-a70f-477b84990e07 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:31:10.092310 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-ebda84a5-2857-46fb-816e-54d9ffae4335 tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:31:10.093015 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-ebda84a5-2857-46fb-816e-54d9ffae4335 tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] [instance: 3dfe0046-8259-4d54-9bd3-5031b4eedeb3] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:31:10.099262 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-ebda84a5-2857-46fb-816e-54d9ffae4335 tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:31:10.099702 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-ebda84a5-2857-46fb-816e-54d9ffae4335 tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:31:10.101545 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-ebda84a5-2857-46fb-816e-54d9ffae4335 tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:31:10.102039 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-ebda84a5-2857-46fb-816e-54d9ffae4335 tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:31:10.290895 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-8e937019-8fb7-4524-a70f-477b84990e07 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb49b631c234f9a9fd47049b9b2e097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faead990837d43de8ec54bfaf24361de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:31:10.293734 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-ebda84a5-2857-46fb-816e-54d9ffae4335 tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5af2248451d3483d9742887d614a5077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520d3d5e2e804be1bd5dc9bfc50c5de8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:31:10.299660 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-8e937019-8fb7-4524-a70f-477b84990e07 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] 10.222.0.46 "GET /compute/v2.1/servers/81874e0c-3350-44a3-8108-be514b727575" status: 200 len: 1366 microversion: 2.1 time: 0.227227 Aug 04 05:31:10.300815 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 348/691] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:31:10 2022] GET /compute/v2.1/servers/81874e0c-3350-44a3-8108-be514b727575 => generated 1366 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:31:10.301527 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-ebda84a5-2857-46fb-816e-54d9ffae4335 tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] 10.222.0.46 "GET /compute/v2.1/servers/3dfe0046-8259-4d54-9bd3-5031b4eedeb3" status: 200 len: 1318 microversion: 2.1 time: 0.213345 Aug 04 05:31:10.302098 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 344/692] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:31:10 2022] GET /compute/v2.1/servers/3dfe0046-8259-4d54-9bd3-5031b4eedeb3 => generated 1318 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 05:31:10.445457 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-513fbcec-5d84-4273-99f9-bfb07ce8cc6a tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:31:10.446166 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-513fbcec-5d84-4273-99f9-bfb07ce8cc6a tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] [instance: 2e3bce83-6dff-479d-a54c-8f660fbbcdc5] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:31:10.452166 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-513fbcec-5d84-4273-99f9-bfb07ce8cc6a tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:31:10.452683 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-513fbcec-5d84-4273-99f9-bfb07ce8cc6a tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:31:10.453443 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-513fbcec-5d84-4273-99f9-bfb07ce8cc6a tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:31:10.453869 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-513fbcec-5d84-4273-99f9-bfb07ce8cc6a tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:31:10.653861 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-513fbcec-5d84-4273-99f9-bfb07ce8cc6a tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:31:10.662089 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-513fbcec-5d84-4273-99f9-bfb07ce8cc6a tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:31:10.663710 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-513fbcec-5d84-4273-99f9-bfb07ce8cc6a tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:31:10.664853 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-513fbcec-5d84-4273-99f9-bfb07ce8cc6a tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] 10.222.0.46 "GET /compute/v2.1/servers/2e3bce83-6dff-479d-a54c-8f660fbbcdc5" status: 200 len: 1407 microversion: 2.20 time: 0.223778 Aug 04 05:31:10.665458 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 349/693] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Aug 4 05:31:10 2022] GET /compute/v2.1/servers/2e3bce83-6dff-479d-a54c-8f660fbbcdc5 => generated 1407 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 05:31:10.821072 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-89ba78e9-9f10-4e79-8b01-eb296f9a8fd6 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:31:10.821724 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-89ba78e9-9f10-4e79-8b01-eb296f9a8fd6 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] [instance: 938a0d12-9045-4220-b0ee-a4ed0a3c4b6a] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:31:10.827772 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-89ba78e9-9f10-4e79-8b01-eb296f9a8fd6 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:31:10.828219 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-89ba78e9-9f10-4e79-8b01-eb296f9a8fd6 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:31:10.828994 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-89ba78e9-9f10-4e79-8b01-eb296f9a8fd6 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:31:10.829427 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-89ba78e9-9f10-4e79-8b01-eb296f9a8fd6 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:31:10.972275 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-89ba78e9-9f10-4e79-8b01-eb296f9a8fd6 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb4dea95659c473b9b193c6234186430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1ca4b83dc874bda9f33e06f4910608c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:31:10.980964 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-89ba78e9-9f10-4e79-8b01-eb296f9a8fd6 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] 10.222.0.46 "GET /compute/v2.1/servers/938a0d12-9045-4220-b0ee-a4ed0a3c4b6a" status: 200 len: 1363 microversion: 2.1 time: 0.164419 Aug 04 05:31:10.981829 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 345/694] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:31:10 2022] GET /compute/v2.1/servers/938a0d12-9045-4220-b0ee-a4ed0a3c4b6a => generated 1363 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:31:11.123058 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [req-45ca9285-8f1f-4ee3-b507-22357d9ad6be req-4ceca107-7964-464e-b821-38f7026fbec4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "81874e0c-3350-44a3-8108-be514b727575", "name": "network-vif-plugged", "status": "completed", "tag": "2bdd1a30-d52a-4486-a7b1-3ca17440e0a8"}, {"server_uuid": "938a0d12-9045-4220-b0ee-a4ed0a3c4b6a", "name": "network-vif-plugged", "status": "completed", "tag": "96eaa044-09b6-458e-884c-ed2bb97c5253"}]} {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:31:11.134618 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [req-45ca9285-8f1f-4ee3-b507-22357d9ad6be req-4ceca107-7964-464e-b821-38f7026fbec4 service nova] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:31:11.135056 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [req-45ca9285-8f1f-4ee3-b507-22357d9ad6be req-4ceca107-7964-464e-b821-38f7026fbec4 service nova] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:31:11.148063 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.compute.server_external_events [req-45ca9285-8f1f-4ee3-b507-22357d9ad6be req-4ceca107-7964-464e-b821-38f7026fbec4 service nova] Creating event network-vif-plugged:2bdd1a30-d52a-4486-a7b1-3ca17440e0a8 for instance 81874e0c-3350-44a3-8108-be514b727575 on hv-cinder-85207 Aug 04 05:31:11.148566 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.compute.server_external_events [req-45ca9285-8f1f-4ee3-b507-22357d9ad6be req-4ceca107-7964-464e-b821-38f7026fbec4 service nova] Creating event network-vif-plugged:96eaa044-09b6-458e-884c-ed2bb97c5253 for instance 938a0d12-9045-4220-b0ee-a4ed0a3c4b6a on hv-cinder-85207 Aug 04 05:31:11.154710 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [req-45ca9285-8f1f-4ee3-b507-22357d9ad6be req-4ceca107-7964-464e-b821-38f7026fbec4 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.035264 Aug 04 05:31:11.155564 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 350/695] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Aug 4 05:31:11 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:31:11.321580 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-45dca08b-0658-4d88-944a-74e3cb0ef932 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:31:11.322302 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-45dca08b-0658-4d88-944a-74e3cb0ef932 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] [instance: 81874e0c-3350-44a3-8108-be514b727575] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:31:11.328924 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-45dca08b-0658-4d88-944a-74e3cb0ef932 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:31:11.329366 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-45dca08b-0658-4d88-944a-74e3cb0ef932 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:31:11.330150 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-45dca08b-0658-4d88-944a-74e3cb0ef932 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:31:11.330610 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-45dca08b-0658-4d88-944a-74e3cb0ef932 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:31:11.330761 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-d637610d-9b6a-481f-9ac7-463f155a936f tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:31:11.331306 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-d637610d-9b6a-481f-9ac7-463f155a936f tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] [instance: 3dfe0046-8259-4d54-9bd3-5031b4eedeb3] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:31:11.338542 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-d637610d-9b6a-481f-9ac7-463f155a936f tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:31:11.338987 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-d637610d-9b6a-481f-9ac7-463f155a936f tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:31:11.339840 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-d637610d-9b6a-481f-9ac7-463f155a936f tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:31:11.340267 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-d637610d-9b6a-481f-9ac7-463f155a936f tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:31:11.632456 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-45dca08b-0658-4d88-944a-74e3cb0ef932 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb49b631c234f9a9fd47049b9b2e097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faead990837d43de8ec54bfaf24361de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:31:11.640205 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-45dca08b-0658-4d88-944a-74e3cb0ef932 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] 10.222.0.46 "GET /compute/v2.1/servers/81874e0c-3350-44a3-8108-be514b727575" status: 200 len: 1366 microversion: 2.1 time: 0.323216 Aug 04 05:31:11.640678 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-d637610d-9b6a-481f-9ac7-463f155a936f tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5af2248451d3483d9742887d614a5077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520d3d5e2e804be1bd5dc9bfc50c5de8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:31:11.654144 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 346/696] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:31:11 2022] GET /compute/v2.1/servers/81874e0c-3350-44a3-8108-be514b727575 => generated 1366 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:31:11.654540 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-d637610d-9b6a-481f-9ac7-463f155a936f tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] 10.222.0.46 "GET /compute/v2.1/servers/3dfe0046-8259-4d54-9bd3-5031b4eedeb3" status: 200 len: 1506 microversion: 2.1 time: 0.323722 Aug 04 05:31:11.654540 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 351/697] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:31:11 2022] GET /compute/v2.1/servers/3dfe0046-8259-4d54-9bd3-5031b4eedeb3 => generated 1506 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 05:31:11.669809 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-7f815bc2-f629-44e0-871f-267c16774d61 tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e8ac58ff-dd9d-4feb-9eba-3c7ab48e04ed", "device": "/dev/sdb"}} {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:31:11.672353 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-7f815bc2-f629-44e0-871f-267c16774d61 tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] [instance: 3dfe0046-8259-4d54-9bd3-5031b4eedeb3] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:31:11.679418 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-7f815bc2-f629-44e0-871f-267c16774d61 tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:31:11.680009 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-7f815bc2-f629-44e0-871f-267c16774d61 tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:31:11.680991 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-7f815bc2-f629-44e0-871f-267c16774d61 tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:31:11.681598 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-7f815bc2-f629-44e0-871f-267c16774d61 tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:31:11.689669 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-ed058c33-6cb5-46b9-887b-ff023bc99fcd tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:31:11.690388 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-ed058c33-6cb5-46b9-887b-ff023bc99fcd tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] [instance: 2e3bce83-6dff-479d-a54c-8f660fbbcdc5] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:31:11.696655 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-ed058c33-6cb5-46b9-887b-ff023bc99fcd tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:31:11.697616 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-ed058c33-6cb5-46b9-887b-ff023bc99fcd tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:31:11.698475 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-ed058c33-6cb5-46b9-887b-ff023bc99fcd tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:31:11.698980 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-ed058c33-6cb5-46b9-887b-ff023bc99fcd tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:31:11.835216 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-ed058c33-6cb5-46b9-887b-ff023bc99fcd tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:31:11.843441 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-ed058c33-6cb5-46b9-887b-ff023bc99fcd tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:31:11.844927 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-ed058c33-6cb5-46b9-887b-ff023bc99fcd tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:31:11.846012 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-ed058c33-6cb5-46b9-887b-ff023bc99fcd tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] 10.222.0.46 "GET /compute/v2.1/servers/2e3bce83-6dff-479d-a54c-8f660fbbcdc5" status: 200 len: 1407 microversion: 2.20 time: 0.160332 Aug 04 05:31:11.846615 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 352/698] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Aug 4 05:31:11 2022] GET /compute/v2.1/servers/2e3bce83-6dff-479d-a54c-8f660fbbcdc5 => generated 1407 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 05:31:12.003354 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-f426ea04-ff28-485f-ae10-0893926f3b71 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:31:12.004393 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-f426ea04-ff28-485f-ae10-0893926f3b71 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] [instance: 938a0d12-9045-4220-b0ee-a4ed0a3c4b6a] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:31:12.012392 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-f426ea04-ff28-485f-ae10-0893926f3b71 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:31:12.012916 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-f426ea04-ff28-485f-ae10-0893926f3b71 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:31:12.013824 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-f426ea04-ff28-485f-ae10-0893926f3b71 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:31:12.014680 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-f426ea04-ff28-485f-ae10-0893926f3b71 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:31:12.036191 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG dbcounter [-] [118476] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=118476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:31:12.187636 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-f426ea04-ff28-485f-ae10-0893926f3b71 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb4dea95659c473b9b193c6234186430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1ca4b83dc874bda9f33e06f4910608c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:31:12.195728 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-f426ea04-ff28-485f-ae10-0893926f3b71 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] 10.222.0.46 "GET /compute/v2.1/servers/938a0d12-9045-4220-b0ee-a4ed0a3c4b6a" status: 200 len: 1363 microversion: 2.1 time: 0.197251 Aug 04 05:31:12.196299 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 353/699] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:31:11 2022] GET /compute/v2.1/servers/938a0d12-9045-4220-b0ee-a4ed0a3c4b6a => generated 1363 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 05:31:12.608628 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-7f815bc2-f629-44e0-871f-267c16774d61 tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] 10.222.0.46 "POST /compute/v2.1/servers/3dfe0046-8259-4d54-9bd3-5031b4eedeb3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.942665 Aug 04 05:31:12.610423 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 347/700] 10.222.0.46 () {60 vars in 1323 bytes} [Thu Aug 4 05:31:11 2022] POST /compute/v2.1/servers/3dfe0046-8259-4d54-9bd3-5031b4eedeb3/os-volume_attachments => generated 194 bytes in 944 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:31:12.661760 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-afdaf0d5-3b85-48e7-8332-8995b9f3cd38 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:31:12.662538 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-afdaf0d5-3b85-48e7-8332-8995b9f3cd38 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] [instance: 81874e0c-3350-44a3-8108-be514b727575] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:31:12.668730 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-afdaf0d5-3b85-48e7-8332-8995b9f3cd38 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:31:12.669180 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-afdaf0d5-3b85-48e7-8332-8995b9f3cd38 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:31:12.669959 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-afdaf0d5-3b85-48e7-8332-8995b9f3cd38 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:31:12.670427 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-afdaf0d5-3b85-48e7-8332-8995b9f3cd38 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:31:12.801463 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-afdaf0d5-3b85-48e7-8332-8995b9f3cd38 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb49b631c234f9a9fd47049b9b2e097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faead990837d43de8ec54bfaf24361de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:31:12.809717 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-afdaf0d5-3b85-48e7-8332-8995b9f3cd38 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] 10.222.0.46 "GET /compute/v2.1/servers/81874e0c-3350-44a3-8108-be514b727575" status: 200 len: 1366 microversion: 2.1 time: 0.151859 Aug 04 05:31:12.810294 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 354/701] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:31:12 2022] GET /compute/v2.1/servers/81874e0c-3350-44a3-8108-be514b727575 => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:31:12.870721 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-244bbf0d-2536-47c1-93c4-ee0e8816d8f6 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:31:12.871440 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-244bbf0d-2536-47c1-93c4-ee0e8816d8f6 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] [instance: 2e3bce83-6dff-479d-a54c-8f660fbbcdc5] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:31:12.877749 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-244bbf0d-2536-47c1-93c4-ee0e8816d8f6 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:31:12.878199 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-244bbf0d-2536-47c1-93c4-ee0e8816d8f6 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:31:12.878991 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-244bbf0d-2536-47c1-93c4-ee0e8816d8f6 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:31:12.879484 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-244bbf0d-2536-47c1-93c4-ee0e8816d8f6 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:31:13.009801 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-244bbf0d-2536-47c1-93c4-ee0e8816d8f6 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:31:13.017972 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-244bbf0d-2536-47c1-93c4-ee0e8816d8f6 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:31:13.019644 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-244bbf0d-2536-47c1-93c4-ee0e8816d8f6 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:31:13.020828 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-244bbf0d-2536-47c1-93c4-ee0e8816d8f6 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] 10.222.0.46 "GET /compute/v2.1/servers/2e3bce83-6dff-479d-a54c-8f660fbbcdc5" status: 200 len: 1407 microversion: 2.20 time: 0.155483 Aug 04 05:31:13.021838 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 348/702] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Aug 4 05:31:12 2022] GET /compute/v2.1/servers/2e3bce83-6dff-479d-a54c-8f660fbbcdc5 => generated 1407 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 05:31:13.217640 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-196c829c-7eab-4844-a98b-ea146a9c55b4 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:31:13.218248 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-196c829c-7eab-4844-a98b-ea146a9c55b4 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] [instance: 938a0d12-9045-4220-b0ee-a4ed0a3c4b6a] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:31:13.225997 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-196c829c-7eab-4844-a98b-ea146a9c55b4 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:31:13.226799 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-196c829c-7eab-4844-a98b-ea146a9c55b4 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:31:13.227610 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-196c829c-7eab-4844-a98b-ea146a9c55b4 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:31:13.228043 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-196c829c-7eab-4844-a98b-ea146a9c55b4 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:31:13.367393 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-196c829c-7eab-4844-a98b-ea146a9c55b4 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb4dea95659c473b9b193c6234186430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1ca4b83dc874bda9f33e06f4910608c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:31:13.375154 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-196c829c-7eab-4844-a98b-ea146a9c55b4 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] 10.222.0.46 "GET /compute/v2.1/servers/938a0d12-9045-4220-b0ee-a4ed0a3c4b6a" status: 200 len: 1363 microversion: 2.1 time: 0.161744 Aug 04 05:31:13.375729 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 355/703] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:31:13 2022] GET /compute/v2.1/servers/938a0d12-9045-4220-b0ee-a4ed0a3c4b6a => generated 1363 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:31:13.830921 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-e5c301c7-7907-4077-9b23-302bdc4c16ac tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:31:13.831521 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-e5c301c7-7907-4077-9b23-302bdc4c16ac tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] [instance: 81874e0c-3350-44a3-8108-be514b727575] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:31:13.838573 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-e5c301c7-7907-4077-9b23-302bdc4c16ac tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:31:13.839017 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-e5c301c7-7907-4077-9b23-302bdc4c16ac tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:31:13.839764 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-e5c301c7-7907-4077-9b23-302bdc4c16ac tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:31:13.840187 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-e5c301c7-7907-4077-9b23-302bdc4c16ac tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:31:13.969743 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-e5c301c7-7907-4077-9b23-302bdc4c16ac tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb49b631c234f9a9fd47049b9b2e097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faead990837d43de8ec54bfaf24361de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:31:13.977913 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-e5c301c7-7907-4077-9b23-302bdc4c16ac tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] 10.222.0.46 "GET /compute/v2.1/servers/81874e0c-3350-44a3-8108-be514b727575" status: 200 len: 1556 microversion: 2.1 time: 0.150829 Aug 04 05:31:13.978525 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 349/704] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:31:13 2022] GET /compute/v2.1/servers/81874e0c-3350-44a3-8108-be514b727575 => generated 1556 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 05:31:13.997638 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-03dd4138-443e-4d59-9793-f05a56d2fe9c tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:31:13.998123 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-03dd4138-443e-4d59-9793-f05a56d2fe9c tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] [instance: 81874e0c-3350-44a3-8108-be514b727575] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:31:14.004091 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-03dd4138-443e-4d59-9793-f05a56d2fe9c tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:31:14.004535 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-03dd4138-443e-4d59-9793-f05a56d2fe9c tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:31:14.005284 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-03dd4138-443e-4d59-9793-f05a56d2fe9c tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:31:14.005720 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-03dd4138-443e-4d59-9793-f05a56d2fe9c tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:31:14.044842 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-74029bcf-d390-4448-8a3b-e4bd2e63616b tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:31:14.045457 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-74029bcf-d390-4448-8a3b-e4bd2e63616b tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] [instance: 2e3bce83-6dff-479d-a54c-8f660fbbcdc5] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:31:14.051384 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-74029bcf-d390-4448-8a3b-e4bd2e63616b tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:31:14.051830 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-74029bcf-d390-4448-8a3b-e4bd2e63616b tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:31:14.052599 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-74029bcf-d390-4448-8a3b-e4bd2e63616b tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:31:14.053038 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-74029bcf-d390-4448-8a3b-e4bd2e63616b tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:31:14.082266 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-03dd4138-443e-4d59-9793-f05a56d2fe9c tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] 10.222.0.46 "GET /compute/v2.1/servers/81874e0c-3350-44a3-8108-be514b727575/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.088445 Aug 04 05:31:14.082888 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 356/705] 10.222.0.46 () {58 vars in 1275 bytes} [Thu Aug 4 05:31:13 2022] GET /compute/v2.1/servers/81874e0c-3350-44a3-8108-be514b727575/os-interface => generated 284 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:31:14.187081 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-74029bcf-d390-4448-8a3b-e4bd2e63616b tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:31:14.195533 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-74029bcf-d390-4448-8a3b-e4bd2e63616b tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:31:14.197040 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-74029bcf-d390-4448-8a3b-e4bd2e63616b tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:31:14.198153 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-74029bcf-d390-4448-8a3b-e4bd2e63616b tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] 10.222.0.46 "GET /compute/v2.1/servers/2e3bce83-6dff-479d-a54c-8f660fbbcdc5" status: 200 len: 1407 microversion: 2.20 time: 0.157206 Aug 04 05:31:14.198818 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 350/706] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Aug 4 05:31:14 2022] GET /compute/v2.1/servers/2e3bce83-6dff-479d-a54c-8f660fbbcdc5 => generated 1407 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 05:31:14.398413 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-f9e0bce3-527e-4c5b-a1af-9e083ab475da tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:31:14.399023 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-f9e0bce3-527e-4c5b-a1af-9e083ab475da tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] [instance: 938a0d12-9045-4220-b0ee-a4ed0a3c4b6a] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:31:14.405220 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-f9e0bce3-527e-4c5b-a1af-9e083ab475da tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:31:14.405664 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-f9e0bce3-527e-4c5b-a1af-9e083ab475da tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:31:14.406470 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-f9e0bce3-527e-4c5b-a1af-9e083ab475da tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:31:14.406908 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-f9e0bce3-527e-4c5b-a1af-9e083ab475da tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:31:14.544404 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-f9e0bce3-527e-4c5b-a1af-9e083ab475da tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb4dea95659c473b9b193c6234186430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1ca4b83dc874bda9f33e06f4910608c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:31:14.554026 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-f9e0bce3-527e-4c5b-a1af-9e083ab475da tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] 10.222.0.46 "GET /compute/v2.1/servers/938a0d12-9045-4220-b0ee-a4ed0a3c4b6a" status: 200 len: 1363 microversion: 2.1 time: 0.159013 Aug 04 05:31:14.554026 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 357/707] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:31:14 2022] GET /compute/v2.1/servers/938a0d12-9045-4220-b0ee-a4ed0a3c4b6a => generated 1363 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:31:15.086810 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [req-b980c6a0-940e-455c-9da2-3bdcd9736793 req-d0127ec0-335f-47fd-8c92-e7f5aeab9b9c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "81874e0c-3350-44a3-8108-be514b727575", "tag": "2bdd1a30-d52a-4486-a7b1-3ca17440e0a8"}]} {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:31:15.096926 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG dbcounter [-] [118476] Writing DB stats nova_cell0:SELECT=24 {{(pid=118476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:31:15.104658 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [req-b980c6a0-940e-455c-9da2-3bdcd9736793 req-d0127ec0-335f-47fd-8c92-e7f5aeab9b9c service nova] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:31:15.106256 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [req-b980c6a0-940e-455c-9da2-3bdcd9736793 req-d0127ec0-335f-47fd-8c92-e7f5aeab9b9c service nova] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:31:15.120447 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.compute.server_external_events [req-b980c6a0-940e-455c-9da2-3bdcd9736793 req-d0127ec0-335f-47fd-8c92-e7f5aeab9b9c service nova] Creating event network-changed:2bdd1a30-d52a-4486-a7b1-3ca17440e0a8 for instance 81874e0c-3350-44a3-8108-be514b727575 on hv-cinder-85207 Aug 04 05:31:15.125884 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [req-b980c6a0-940e-455c-9da2-3bdcd9736793 req-d0127ec0-335f-47fd-8c92-e7f5aeab9b9c service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043572 Aug 04 05:31:15.126613 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 351/708] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Aug 4 05:31:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:31:15.221632 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-96f09452-4d8e-4d72-a221-a1c1e75633c3 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:31:15.222239 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-96f09452-4d8e-4d72-a221-a1c1e75633c3 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] [instance: 2e3bce83-6dff-479d-a54c-8f660fbbcdc5] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:31:15.224202 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG dbcounter [-] [118477] Writing DB stats nova_cell0:SELECT=2 {{(pid=118477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:31:15.230487 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-96f09452-4d8e-4d72-a221-a1c1e75633c3 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:31:15.234885 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-96f09452-4d8e-4d72-a221-a1c1e75633c3 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:31:15.234885 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-96f09452-4d8e-4d72-a221-a1c1e75633c3 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:31:15.234885 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-96f09452-4d8e-4d72-a221-a1c1e75633c3 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:31:15.369619 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-96f09452-4d8e-4d72-a221-a1c1e75633c3 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:31:15.377739 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-96f09452-4d8e-4d72-a221-a1c1e75633c3 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:31:15.379376 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-96f09452-4d8e-4d72-a221-a1c1e75633c3 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:31:15.380594 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-96f09452-4d8e-4d72-a221-a1c1e75633c3 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] 10.222.0.46 "GET /compute/v2.1/servers/2e3bce83-6dff-479d-a54c-8f660fbbcdc5" status: 200 len: 1407 microversion: 2.20 time: 0.163342 Aug 04 05:31:15.381228 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 358/709] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Aug 4 05:31:15 2022] GET /compute/v2.1/servers/2e3bce83-6dff-479d-a54c-8f660fbbcdc5 => generated 1407 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 05:31:15.575135 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-3666fca3-df40-400f-9f37-244998278bde tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:31:15.575930 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-3666fca3-df40-400f-9f37-244998278bde tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] [instance: 938a0d12-9045-4220-b0ee-a4ed0a3c4b6a] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:31:15.582610 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-3666fca3-df40-400f-9f37-244998278bde tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:31:15.583153 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-3666fca3-df40-400f-9f37-244998278bde tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:31:15.583981 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-3666fca3-df40-400f-9f37-244998278bde tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:31:15.584996 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-3666fca3-df40-400f-9f37-244998278bde tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:31:15.772620 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-3666fca3-df40-400f-9f37-244998278bde tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb4dea95659c473b9b193c6234186430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1ca4b83dc874bda9f33e06f4910608c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:31:15.782711 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-3666fca3-df40-400f-9f37-244998278bde tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] 10.222.0.46 "GET /compute/v2.1/servers/938a0d12-9045-4220-b0ee-a4ed0a3c4b6a" status: 200 len: 1548 microversion: 2.1 time: 0.212914 Aug 04 05:31:15.786353 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 352/710] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:31:15 2022] GET /compute/v2.1/servers/938a0d12-9045-4220-b0ee-a4ed0a3c4b6a => generated 1548 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:31:15.809008 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-4c329558-dea9-42c7-ad12-8ec3c9bae3aa tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:31:15.809524 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-4c329558-dea9-42c7-ad12-8ec3c9bae3aa tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] [instance: 938a0d12-9045-4220-b0ee-a4ed0a3c4b6a] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:31:15.817727 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-4c329558-dea9-42c7-ad12-8ec3c9bae3aa tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:31:15.817867 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-4c329558-dea9-42c7-ad12-8ec3c9bae3aa tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:31:15.819823 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-4c329558-dea9-42c7-ad12-8ec3c9bae3aa tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:31:15.820457 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-4c329558-dea9-42c7-ad12-8ec3c9bae3aa tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:31:15.875721 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG dbcounter [-] [118477] Writing DB stats nova_cell0:SELECT=8 {{(pid=118477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:31:15.985672 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-4c329558-dea9-42c7-ad12-8ec3c9bae3aa tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] 10.222.0.46 "GET /compute/v2.1/servers/938a0d12-9045-4220-b0ee-a4ed0a3c4b6a/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.180666 Aug 04 05:31:15.986646 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 359/711] 10.222.0.46 () {58 vars in 1275 bytes} [Thu Aug 4 05:31:15 2022] GET /compute/v2.1/servers/938a0d12-9045-4220-b0ee-a4ed0a3c4b6a/os-interface => generated 284 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:31:16.404146 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-b6c301be-3d96-4786-9f5a-d4b254f4a921 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:31:16.405030 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-b6c301be-3d96-4786-9f5a-d4b254f4a921 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] [instance: 2e3bce83-6dff-479d-a54c-8f660fbbcdc5] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:31:16.412160 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-b6c301be-3d96-4786-9f5a-d4b254f4a921 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:31:16.413659 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-b6c301be-3d96-4786-9f5a-d4b254f4a921 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:31:16.414757 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-b6c301be-3d96-4786-9f5a-d4b254f4a921 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:31:16.415374 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-b6c301be-3d96-4786-9f5a-d4b254f4a921 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:31:16.974673 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [req-09409b94-f3c1-4616-9134-3895a607416b req-3a470693-4aab-49f0-a6e5-32b3f97d7839 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e3bce83-6dff-479d-a54c-8f660fbbcdc5", "name": "network-vif-plugged", "status": "completed", "tag": "ddeaefd6-9468-4764-8ef0-df45fd5ea8db"}]} {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:31:16.987041 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [req-09409b94-f3c1-4616-9134-3895a607416b req-3a470693-4aab-49f0-a6e5-32b3f97d7839 service nova] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:31:16.987865 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [req-09409b94-f3c1-4616-9134-3895a607416b req-3a470693-4aab-49f0-a6e5-32b3f97d7839 service nova] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:31:17.000936 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.compute.server_external_events [req-09409b94-f3c1-4616-9134-3895a607416b req-3a470693-4aab-49f0-a6e5-32b3f97d7839 service nova] Creating event network-vif-plugged:ddeaefd6-9468-4764-8ef0-df45fd5ea8db for instance 2e3bce83-6dff-479d-a54c-8f660fbbcdc5 on hv-cinder-85207 Aug 04 05:31:17.006748 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [req-09409b94-f3c1-4616-9134-3895a607416b req-3a470693-4aab-49f0-a6e5-32b3f97d7839 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036214 Aug 04 05:31:17.007674 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 360/712] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Aug 4 05:31:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 05:31:17.071061 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-b6c301be-3d96-4786-9f5a-d4b254f4a921 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:31:17.079365 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-b6c301be-3d96-4786-9f5a-d4b254f4a921 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:31:17.080868 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-b6c301be-3d96-4786-9f5a-d4b254f4a921 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:31:17.082211 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-b6c301be-3d96-4786-9f5a-d4b254f4a921 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] 10.222.0.46 "GET /compute/v2.1/servers/2e3bce83-6dff-479d-a54c-8f660fbbcdc5" status: 200 len: 1407 microversion: 2.20 time: 0.682066 Aug 04 05:31:17.082968 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 353/713] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Aug 4 05:31:16 2022] GET /compute/v2.1/servers/2e3bce83-6dff-479d-a54c-8f660fbbcdc5 => generated 1407 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 05:31:17.391719 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [req-78ec92fa-cad0-4071-9225-77b61b0d96a3 req-b870e7ad-26a4-4084-b4e0-49e09532244f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "938a0d12-9045-4220-b0ee-a4ed0a3c4b6a", "tag": "96eaa044-09b6-458e-884c-ed2bb97c5253"}]} {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:31:17.403647 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [req-78ec92fa-cad0-4071-9225-77b61b0d96a3 req-b870e7ad-26a4-4084-b4e0-49e09532244f service nova] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:31:17.404307 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [req-78ec92fa-cad0-4071-9225-77b61b0d96a3 req-b870e7ad-26a4-4084-b4e0-49e09532244f service nova] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:31:17.417360 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.compute.server_external_events [req-78ec92fa-cad0-4071-9225-77b61b0d96a3 req-b870e7ad-26a4-4084-b4e0-49e09532244f service nova] Creating event network-changed:96eaa044-09b6-458e-884c-ed2bb97c5253 for instance 938a0d12-9045-4220-b0ee-a4ed0a3c4b6a on hv-cinder-85207 Aug 04 05:31:17.422631 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [req-78ec92fa-cad0-4071-9225-77b61b0d96a3 req-b870e7ad-26a4-4084-b4e0-49e09532244f service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034798 Aug 04 05:31:17.424275 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 361/714] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Aug 4 05:31:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 05:31:18.106131 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-38a09b65-2876-4907-a8da-6819297de561 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:31:18.107368 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-38a09b65-2876-4907-a8da-6819297de561 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] [instance: 2e3bce83-6dff-479d-a54c-8f660fbbcdc5] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:31:18.114209 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-38a09b65-2876-4907-a8da-6819297de561 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:31:18.114743 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-38a09b65-2876-4907-a8da-6819297de561 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:31:18.116088 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-38a09b65-2876-4907-a8da-6819297de561 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:31:18.116593 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-38a09b65-2876-4907-a8da-6819297de561 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:31:18.253054 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-38a09b65-2876-4907-a8da-6819297de561 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:31:18.261894 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-38a09b65-2876-4907-a8da-6819297de561 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:31:18.263446 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-38a09b65-2876-4907-a8da-6819297de561 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:31:18.264584 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-38a09b65-2876-4907-a8da-6819297de561 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] 10.222.0.46 "GET /compute/v2.1/servers/2e3bce83-6dff-479d-a54c-8f660fbbcdc5" status: 200 len: 1407 microversion: 2.20 time: 0.162401 Aug 04 05:31:18.265169 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 354/715] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Aug 4 05:31:18 2022] GET /compute/v2.1/servers/2e3bce83-6dff-479d-a54c-8f660fbbcdc5 => generated 1407 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 05:31:19.288932 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-54e7df43-a3ab-4066-b834-1d0b6ff9aacf tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:31:19.290373 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-54e7df43-a3ab-4066-b834-1d0b6ff9aacf tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] [instance: 2e3bce83-6dff-479d-a54c-8f660fbbcdc5] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:31:19.297476 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-54e7df43-a3ab-4066-b834-1d0b6ff9aacf tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:31:19.297929 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-54e7df43-a3ab-4066-b834-1d0b6ff9aacf tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:31:19.298739 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-54e7df43-a3ab-4066-b834-1d0b6ff9aacf tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:31:19.299175 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-54e7df43-a3ab-4066-b834-1d0b6ff9aacf tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:31:19.315572 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG dbcounter [-] [118477] Writing DB stats nova_cell1:SELECT=100 {{(pid=118477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:31:19.462670 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-54e7df43-a3ab-4066-b834-1d0b6ff9aacf tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:31:19.470546 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-54e7df43-a3ab-4066-b834-1d0b6ff9aacf tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:31:19.472079 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-54e7df43-a3ab-4066-b834-1d0b6ff9aacf tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:31:19.473215 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-54e7df43-a3ab-4066-b834-1d0b6ff9aacf tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] 10.222.0.46 "GET /compute/v2.1/servers/2e3bce83-6dff-479d-a54c-8f660fbbcdc5" status: 200 len: 1599 microversion: 2.20 time: 0.189156 Aug 04 05:31:19.473757 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 362/716] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Aug 4 05:31:19 2022] GET /compute/v2.1/servers/2e3bce83-6dff-479d-a54c-8f660fbbcdc5 => generated 1599 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 05:31:19.497728 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-5eb5356d-28f8-4275-95c2-f154a3130ee1 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:31:19.498268 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-5eb5356d-28f8-4275-95c2-f154a3130ee1 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] [instance: 2e3bce83-6dff-479d-a54c-8f660fbbcdc5] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:31:19.504855 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-5eb5356d-28f8-4275-95c2-f154a3130ee1 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:31:19.505302 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-5eb5356d-28f8-4275-95c2-f154a3130ee1 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:31:19.506055 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-5eb5356d-28f8-4275-95c2-f154a3130ee1 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:31:19.507098 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-5eb5356d-28f8-4275-95c2-f154a3130ee1 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:31:19.583341 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-5eb5356d-28f8-4275-95c2-f154a3130ee1 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] 10.222.0.46 "GET /compute/v2.1/servers/2e3bce83-6dff-479d-a54c-8f660fbbcdc5/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.089708 Aug 04 05:31:19.583950 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 355/717] 10.222.0.46 () {60 vars in 1316 bytes} [Thu Aug 4 05:31:19 2022] GET /compute/v2.1/servers/2e3bce83-6dff-479d-a54c-8f660fbbcdc5/os-interface => generated 284 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 05:31:20.582432 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [req-4b8ab5a4-e6f8-4a01-a893-3c6cabbe7819 req-de9b9cae-b1b6-4876-aeb9-dcfed7edd4fd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2e3bce83-6dff-479d-a54c-8f660fbbcdc5", "tag": "ddeaefd6-9468-4764-8ef0-df45fd5ea8db"}]} {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:31:20.587648 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG dbcounter [-] [118477] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=118477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:31:20.593012 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [req-4b8ab5a4-e6f8-4a01-a893-3c6cabbe7819 req-de9b9cae-b1b6-4876-aeb9-dcfed7edd4fd service nova] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:31:20.593445 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [req-4b8ab5a4-e6f8-4a01-a893-3c6cabbe7819 req-de9b9cae-b1b6-4876-aeb9-dcfed7edd4fd service nova] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:31:20.606548 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.compute.server_external_events [req-4b8ab5a4-e6f8-4a01-a893-3c6cabbe7819 req-de9b9cae-b1b6-4876-aeb9-dcfed7edd4fd service nova] Creating event network-changed:ddeaefd6-9468-4764-8ef0-df45fd5ea8db for instance 2e3bce83-6dff-479d-a54c-8f660fbbcdc5 on hv-cinder-85207 Aug 04 05:31:20.612262 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [req-4b8ab5a4-e6f8-4a01-a893-3c6cabbe7819 req-de9b9cae-b1b6-4876-aeb9-dcfed7edd4fd service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032574 Aug 04 05:31:20.612262 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 363/718] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Aug 4 05:31:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:31:35.926300 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG dbcounter [-] [118476] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=4 {{(pid=118476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:31:35.927180 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG dbcounter [-] [118476] Writing DB stats nova_cell1:SELECT=45,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:31:35.931859 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-e4f46e80-d18c-49b4-b4dc-c8af78df8f6a tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:31:35.932352 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-e4f46e80-d18c-49b4-b4dc-c8af78df8f6a tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] [instance: 3dfe0046-8259-4d54-9bd3-5031b4eedeb3] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:31:35.938185 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-e4f46e80-d18c-49b4-b4dc-c8af78df8f6a tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:31:35.942358 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-e4f46e80-d18c-49b4-b4dc-c8af78df8f6a tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:31:35.942358 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-e4f46e80-d18c-49b4-b4dc-c8af78df8f6a tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:31:35.942358 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-e4f46e80-d18c-49b4-b4dc-c8af78df8f6a tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:31:36.020739 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.objects.instance [None req-e4f46e80-d18c-49b4-b4dc-c8af78df8f6a tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] Lazy-loading 'services' on Instance uuid 3dfe0046-8259-4d54-9bd3-5031b4eedeb3 {{(pid=118476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 05:31:36.369708 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-e4f46e80-d18c-49b4-b4dc-c8af78df8f6a tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] 10.222.0.46 "DELETE /compute/v2.1/servers/3dfe0046-8259-4d54-9bd3-5031b4eedeb3/os-volume_attachments/e8ac58ff-dd9d-4feb-9eba-3c7ab48e04ed" status: 202 len: 0 microversion: 2.1 time: 0.444742 Aug 04 05:31:36.370319 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 356/719] 10.222.0.46 () {58 vars in 1416 bytes} [Thu Aug 4 05:31:35 2022] DELETE /compute/v2.1/servers/3dfe0046-8259-4d54-9bd3-5031b4eedeb3/os-volume_attachments/e8ac58ff-dd9d-4feb-9eba-3c7ab48e04ed => generated 0 bytes in 446 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 05:31:38.545792 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG dbcounter [-] [118477] Writing DB stats nova_cell1:SELECT=5 {{(pid=118477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:31:38.549888 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-b12ca8a4-46af-4b21-baaa-ac6f12eae0d3 tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:31:38.550494 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-b12ca8a4-46af-4b21-baaa-ac6f12eae0d3 tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] [instance: 3dfe0046-8259-4d54-9bd3-5031b4eedeb3] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:31:38.557976 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-b12ca8a4-46af-4b21-baaa-ac6f12eae0d3 tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:31:38.562385 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-b12ca8a4-46af-4b21-baaa-ac6f12eae0d3 tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:31:38.562385 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-b12ca8a4-46af-4b21-baaa-ac6f12eae0d3 tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:31:38.562385 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-b12ca8a4-46af-4b21-baaa-ac6f12eae0d3 tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:31:38.584563 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-b12ca8a4-46af-4b21-baaa-ac6f12eae0d3 tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] [instance: 3dfe0046-8259-4d54-9bd3-5031b4eedeb3] Going to try to terminate instance {{(pid=118477) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 05:31:38.890472 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-b12ca8a4-46af-4b21-baaa-ac6f12eae0d3 tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] 10.222.0.46 "DELETE /compute/v2.1/servers/3dfe0046-8259-4d54-9bd3-5031b4eedeb3" status: 204 len: 0 microversion: 2.1 time: 0.346028 Aug 04 05:31:38.891069 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 364/720] 10.222.0.46 () {58 vars in 1239 bytes} [Thu Aug 4 05:31:38 2022] DELETE /compute/v2.1/servers/3dfe0046-8259-4d54-9bd3-5031b4eedeb3 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 05:31:38.901971 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-5f8f4d51-ca1c-4c32-9ace-88ab6c6711bb tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:31:38.902782 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-5f8f4d51-ca1c-4c32-9ace-88ab6c6711bb tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] [instance: 3dfe0046-8259-4d54-9bd3-5031b4eedeb3] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:31:38.909810 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-5f8f4d51-ca1c-4c32-9ace-88ab6c6711bb tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:31:38.910265 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-5f8f4d51-ca1c-4c32-9ace-88ab6c6711bb tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:31:38.911070 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-5f8f4d51-ca1c-4c32-9ace-88ab6c6711bb tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:31:38.911514 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-5f8f4d51-ca1c-4c32-9ace-88ab6c6711bb tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:31:39.048977 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-5f8f4d51-ca1c-4c32-9ace-88ab6c6711bb tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5af2248451d3483d9742887d614a5077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520d3d5e2e804be1bd5dc9bfc50c5de8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:31:39.056702 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-5f8f4d51-ca1c-4c32-9ace-88ab6c6711bb tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] 10.222.0.46 "GET /compute/v2.1/servers/3dfe0046-8259-4d54-9bd3-5031b4eedeb3" status: 200 len: 1512 microversion: 2.1 time: 0.161008 Aug 04 05:31:39.057278 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 357/721] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:31:38 2022] GET /compute/v2.1/servers/3dfe0046-8259-4d54-9bd3-5031b4eedeb3 => generated 1512 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:31:40.077710 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-fd15319d-3443-48b4-af99-fb486c3fb2a3 tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:31:40.078433 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-fd15319d-3443-48b4-af99-fb486c3fb2a3 tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] [instance: 3dfe0046-8259-4d54-9bd3-5031b4eedeb3] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:31:40.084974 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-fd15319d-3443-48b4-af99-fb486c3fb2a3 tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:31:40.085412 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-fd15319d-3443-48b4-af99-fb486c3fb2a3 tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:31:40.086162 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-fd15319d-3443-48b4-af99-fb486c3fb2a3 tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:31:40.086622 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-fd15319d-3443-48b4-af99-fb486c3fb2a3 tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:31:40.221270 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-fd15319d-3443-48b4-af99-fb486c3fb2a3 tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5af2248451d3483d9742887d614a5077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520d3d5e2e804be1bd5dc9bfc50c5de8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:31:40.229396 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-fd15319d-3443-48b4-af99-fb486c3fb2a3 tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] 10.222.0.46 "GET /compute/v2.1/servers/3dfe0046-8259-4d54-9bd3-5031b4eedeb3" status: 200 len: 1512 microversion: 2.1 time: 0.155866 Aug 04 05:31:40.229961 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 365/722] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:31:40 2022] GET /compute/v2.1/servers/3dfe0046-8259-4d54-9bd3-5031b4eedeb3 => generated 1512 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:31:41.250087 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-a20d7ec2-8b51-418e-b2ab-d864d0f9e824 tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:31:41.250802 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-a20d7ec2-8b51-418e-b2ab-d864d0f9e824 tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] [instance: 3dfe0046-8259-4d54-9bd3-5031b4eedeb3] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:31:41.257368 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-a20d7ec2-8b51-418e-b2ab-d864d0f9e824 tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:31:41.257810 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-a20d7ec2-8b51-418e-b2ab-d864d0f9e824 tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:31:41.259148 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-a20d7ec2-8b51-418e-b2ab-d864d0f9e824 tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:31:41.260246 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-a20d7ec2-8b51-418e-b2ab-d864d0f9e824 tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:31:41.488804 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-a20d7ec2-8b51-418e-b2ab-d864d0f9e824 tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5af2248451d3483d9742887d614a5077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520d3d5e2e804be1bd5dc9bfc50c5de8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:31:41.497477 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-a20d7ec2-8b51-418e-b2ab-d864d0f9e824 tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] 10.222.0.46 "GET /compute/v2.1/servers/3dfe0046-8259-4d54-9bd3-5031b4eedeb3" status: 200 len: 1512 microversion: 2.1 time: 0.251247 Aug 04 05:31:41.498341 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 358/723] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:31:41 2022] GET /compute/v2.1/servers/3dfe0046-8259-4d54-9bd3-5031b4eedeb3 => generated 1512 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:31:41.873012 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [req-a796aba2-f832-45c8-9160-57cb2a93cc60 req-e7921a30-3437-428e-9df4-64f6b31746e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3dfe0046-8259-4d54-9bd3-5031b4eedeb3", "name": "network-vif-deleted", "tag": "3e30258d-1d58-48d0-ac37-b50de7fc5685"}]} {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:31:41.883397 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [req-a796aba2-f832-45c8-9160-57cb2a93cc60 req-e7921a30-3437-428e-9df4-64f6b31746e3 service nova] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:31:41.886477 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [req-a796aba2-f832-45c8-9160-57cb2a93cc60 req-e7921a30-3437-428e-9df4-64f6b31746e3 service nova] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:31:41.896275 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.compute.server_external_events [req-a796aba2-f832-45c8-9160-57cb2a93cc60 req-e7921a30-3437-428e-9df4-64f6b31746e3 service nova] Creating event network-vif-deleted:3e30258d-1d58-48d0-ac37-b50de7fc5685 for instance 3dfe0046-8259-4d54-9bd3-5031b4eedeb3 on hv-cinder-85207 Aug 04 05:31:41.901583 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [req-a796aba2-f832-45c8-9160-57cb2a93cc60 req-e7921a30-3437-428e-9df4-64f6b31746e3 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033035 Aug 04 05:31:41.902193 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 366/724] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Aug 4 05:31:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:31:42.518063 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-74096f62-161c-4eba-854a-11a1986992ee tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:31:42.518689 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-74096f62-161c-4eba-854a-11a1986992ee tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] [instance: 3dfe0046-8259-4d54-9bd3-5031b4eedeb3] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:31:42.525641 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-74096f62-161c-4eba-854a-11a1986992ee tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:31:42.534744 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-74096f62-161c-4eba-854a-11a1986992ee tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:31:42.534744 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-74096f62-161c-4eba-854a-11a1986992ee tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:31:42.534744 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-74096f62-161c-4eba-854a-11a1986992ee tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:31:42.558239 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-74096f62-161c-4eba-854a-11a1986992ee tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:31:42.558709 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-74096f62-161c-4eba-854a-11a1986992ee tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:31:42.559151 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.objects.instance [None req-74096f62-161c-4eba-854a-11a1986992ee tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] Lazy-loading 'fault' on Instance uuid 3dfe0046-8259-4d54-9bd3-5031b4eedeb3 {{(pid=118476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 05:31:42.600571 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-74096f62-161c-4eba-854a-11a1986992ee tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5af2248451d3483d9742887d614a5077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520d3d5e2e804be1bd5dc9bfc50c5de8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:31:42.608263 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-74096f62-161c-4eba-854a-11a1986992ee tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] 10.222.0.46 "GET /compute/v2.1/servers/3dfe0046-8259-4d54-9bd3-5031b4eedeb3" status: 200 len: 1308 microversion: 2.1 time: 0.094151 Aug 04 05:31:42.611475 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 359/725] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:31:42 2022] GET /compute/v2.1/servers/3dfe0046-8259-4d54-9bd3-5031b4eedeb3 => generated 1308 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:31:43.630763 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-cc4cbd70-ccce-4586-8173-24eebd99aa9d tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:31:43.631457 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-cc4cbd70-ccce-4586-8173-24eebd99aa9d tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] [instance: 3dfe0046-8259-4d54-9bd3-5031b4eedeb3] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:31:43.639029 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-cc4cbd70-ccce-4586-8173-24eebd99aa9d tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:31:43.639471 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-cc4cbd70-ccce-4586-8173-24eebd99aa9d tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:31:43.640218 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-cc4cbd70-ccce-4586-8173-24eebd99aa9d tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:31:43.640651 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-cc4cbd70-ccce-4586-8173-24eebd99aa9d tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:31:43.655190 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.wsgi [None req-cc4cbd70-ccce-4586-8173-24eebd99aa9d tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] HTTP exception thrown: Instance 3dfe0046-8259-4d54-9bd3-5031b4eedeb3 could not be found. Aug 04 05:31:43.656807 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-cc4cbd70-ccce-4586-8173-24eebd99aa9d tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] Request method failure captured: Aug 04 05:31:43.656807 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: request: GET /compute/v2.1/servers/3dfe0046-8259-4d54-9bd3-5031b4eedeb3 HTTP/1.1 Aug 04 05:31:43.656807 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: Accept: application/json Aug 04 05:31:43.656807 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: Accept-Encoding: identity Aug 04 05:31:43.656807 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: Connection: close Aug 04 05:31:43.656807 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: Content-Length: 0 Aug 04 05:31:43.656807 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: Content-Type: application/json Aug 04 05:31:43.656807 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: Host: 10.222.0.46 Aug 04 05:31:43.656807 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: Openstack-System-Scope: None Aug 04 05:31:43.656807 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: User-Agent: python-urllib3/1.26.11 Aug 04 05:31:43.656807 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Auth-Token: gAAAAABi61kwTX1Bb2w2An8VY9IljT4THIT-q7oVrnWc7W7ZproVrLJcBk5oSKC-OsORA_k8sFoSueYgwtrqKLzUwkO-Fl0n412JPjyX6XOSFapSKcFz4pNB66KI3dbrYI0tHu3RdlIqAZjBcv3tcpUS_68tq0nnERibEUA5uOdEeGv-Pbw1c00 Aug 04 05:31:43.656807 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Domain-Id: None Aug 04 05:31:43.656807 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Domain-Name: None Aug 04 05:31:43.656807 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Identity-Status: Confirmed Aug 04 05:31:43.656807 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Is-Admin-Project: True Aug 04 05:31:43.656807 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Project-Domain-Id: default Aug 04 05:31:43.656807 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Project-Domain-Name: Default Aug 04 05:31:43.656807 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Project-Id: 520d3d5e2e804be1bd5dc9bfc50c5de8 Aug 04 05:31:43.656807 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Project-Name: tempest-VolumesSnapshotTestJSON-835247731 Aug 04 05:31:43.656807 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Role: member,reader Aug 04 05:31:43.656807 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Roles: member,reader Aug 04 05:31:43.658629 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/520d3d5e2e804be1bd5dc9bfc50c5de8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/520d3d5e2e804be1bd5dc9bfc50c5de8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_520d3d5e2e804be1bd5dc9bfc50c5de8", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/520d3d5e2e804be1bd5dc9bfc50c5de8"}]}] Aug 04 05:31:43.658629 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Tenant: tempest-VolumesSnapshotTestJSON-835247731 Aug 04 05:31:43.658629 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Tenant-Id: 520d3d5e2e804be1bd5dc9bfc50c5de8 Aug 04 05:31:43.658629 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-835247731 Aug 04 05:31:43.658629 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-User: tempest-VolumesSnapshotTestJSON-835247731-project Aug 04 05:31:43.658629 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-User-Domain-Id: default Aug 04 05:31:43.658629 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-User-Domain-Name: Default Aug 04 05:31:43.658629 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-User-Id: 5af2248451d3483d9742887d614a5077 Aug 04 05:31:43.658629 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-User-Name: tempest-VolumesSnapshotTestJSON-835247731-project Aug 04 05:31:43.658629 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: method: > Aug 04 05:31:43.658629 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: exception: Instance 3dfe0046-8259-4d54-9bd3-5031b4eedeb3 could not be found. Aug 04 05:31:43.658629 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: action_args: {'id': '3dfe0046-8259-4d54-9bd3-5031b4eedeb3'} Aug 04 05:31:43.659754 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 05:31:43.659754 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:31:43.659754 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 05:31:43.659754 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 05:31:43.659754 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 05:31:43.659754 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 05:31:43.659754 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 05:31:43.659754 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 05:31:43.659754 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 05:31:43.659754 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 05:31:43.659754 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3dfe0046-8259-4d54-9bd3-5031b4eedeb3 could not be found. Aug 04 05:31:43.659754 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Aug 04 05:31:43.659754 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:31:43.659754 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Aug 04 05:31:43.659754 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:31:43.659754 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:31:43.659754 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:31:43.659754 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 05:31:43.659754 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 05:31:43.659754 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 05:31:43.661285 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 05:31:43.661285 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 05:31:43.661285 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 05:31:43.661285 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 05:31:43.661285 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 05:31:43.661285 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 05:31:43.661285 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 05:31:43.661285 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3dfe0046-8259-4d54-9bd3-5031b4eedeb3 could not be found. Aug 04 05:31:43.661285 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Aug 04 05:31:43.661285 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:31:43.661285 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Aug 04 05:31:43.661285 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:31:43.661285 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:31:43.661285 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:31:43.661285 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 05:31:43.661285 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 05:31:43.661285 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3dfe0046-8259-4d54-9bd3-5031b4eedeb3 could not be found. Aug 04 05:31:43.661285 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Aug 04 05:31:43.662808 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-cc4cbd70-ccce-4586-8173-24eebd99aa9d tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] Returning 404 to user: Instance 3dfe0046-8259-4d54-9bd3-5031b4eedeb3 could not be found. {{(pid=118477) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 05:31:43.662808 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-cc4cbd70-ccce-4586-8173-24eebd99aa9d tempest-VolumesSnapshotTestJSON-835247731 tempest-VolumesSnapshotTestJSON-835247731-project] 10.222.0.46 "GET /compute/v2.1/servers/3dfe0046-8259-4d54-9bd3-5031b4eedeb3" status: 404 len: 111 microversion: 2.1 time: 0.032106 Aug 04 05:31:43.662808 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 367/726] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:31:43 2022] GET /compute/v2.1/servers/3dfe0046-8259-4d54-9bd3-5031b4eedeb3 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 05:32:03.878035 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG dbcounter [-] [118476] Writing DB stats nova_api:SELECT=10 {{(pid=118476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:32:03.878855 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG dbcounter [-] [118476] Writing DB stats nova_cell1:SELECT=29,nova_cell1:INSERT=1 {{(pid=118476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:32:03.978823 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-2019c027-d3bb-4f8a-996e-ac971e5b6df3 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:32:03.979351 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-2019c027-d3bb-4f8a-996e-ac971e5b6df3 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] [instance: 938a0d12-9045-4220-b0ee-a4ed0a3c4b6a] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:32:03.985733 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-2019c027-d3bb-4f8a-996e-ac971e5b6df3 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:32:03.986170 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-2019c027-d3bb-4f8a-996e-ac971e5b6df3 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:32:03.986955 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-2019c027-d3bb-4f8a-996e-ac971e5b6df3 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:32:03.987389 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-2019c027-d3bb-4f8a-996e-ac971e5b6df3 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:32:04.010071 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-2019c027-d3bb-4f8a-996e-ac971e5b6df3 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] 10.222.0.46 "GET /compute/v2.1/servers/938a0d12-9045-4220-b0ee-a4ed0a3c4b6a/ips" status: 200 len: 144 microversion: 2.1 time: 0.137208 Aug 04 05:32:04.010658 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 360/727] 10.222.0.46 () {58 vars in 1248 bytes} [Thu Aug 4 05:32:03 2022] GET /compute/v2.1/servers/938a0d12-9045-4220-b0ee-a4ed0a3c4b6a/ips => generated 144 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:32:05.553270 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-5b3d8c06-2716-4366-983d-48d3976d38c3 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2cb60d25-54d1-4c7a-b368-37e80418efbe"}} {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:32:05.555725 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-5b3d8c06-2716-4366-983d-48d3976d38c3 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] [instance: 938a0d12-9045-4220-b0ee-a4ed0a3c4b6a] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:32:05.557980 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG dbcounter [-] [118477] Writing DB stats nova_api:SELECT=14,nova_api:UPDATE=1 {{(pid=118477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:32:05.558663 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG dbcounter [-] [118477] Writing DB stats nova_cell1:SELECT=24,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:32:05.564028 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-5b3d8c06-2716-4366-983d-48d3976d38c3 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:32:05.565291 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-5b3d8c06-2716-4366-983d-48d3976d38c3 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:32:05.569083 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-5b3d8c06-2716-4366-983d-48d3976d38c3 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:32:05.569083 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-5b3d8c06-2716-4366-983d-48d3976d38c3 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:32:06.146685 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-5b3d8c06-2716-4366-983d-48d3976d38c3 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] 10.222.0.46 "POST /compute/v2.1/servers/938a0d12-9045-4220-b0ee-a4ed0a3c4b6a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.596691 Aug 04 05:32:06.147333 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 368/728] 10.222.0.46 () {60 vars in 1323 bytes} [Thu Aug 4 05:32:05 2022] POST /compute/v2.1/servers/938a0d12-9045-4220-b0ee-a4ed0a3c4b6a/os-volume_attachments => generated 194 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:32:07.381951 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-c5965421-5b09-4541-b45c-a777ba51ac82 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:32:07.382561 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-c5965421-5b09-4541-b45c-a777ba51ac82 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] [instance: 2e3bce83-6dff-479d-a54c-8f660fbbcdc5] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:32:07.388860 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-c5965421-5b09-4541-b45c-a777ba51ac82 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:32:07.389299 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-c5965421-5b09-4541-b45c-a777ba51ac82 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:32:07.390045 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-c5965421-5b09-4541-b45c-a777ba51ac82 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:32:07.390500 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-c5965421-5b09-4541-b45c-a777ba51ac82 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:32:07.415793 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-c5965421-5b09-4541-b45c-a777ba51ac82 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] 10.222.0.46 "GET /compute/v2.1/servers/2e3bce83-6dff-479d-a54c-8f660fbbcdc5/ips" status: 200 len: 152 microversion: 2.20 time: 0.038063 Aug 04 05:32:07.416361 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 361/729] 10.222.0.46 () {60 vars in 1289 bytes} [Thu Aug 4 05:32:07 2022] GET /compute/v2.1/servers/2e3bce83-6dff-479d-a54c-8f660fbbcdc5/ips => generated 152 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 05:32:10.295354 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-bd9c9c9d-f6c0-47ca-9ba6-84f2e51175ea tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:32:10.295974 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-bd9c9c9d-f6c0-47ca-9ba6-84f2e51175ea tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] [instance: 2e3bce83-6dff-479d-a54c-8f660fbbcdc5] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:32:10.303299 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-bd9c9c9d-f6c0-47ca-9ba6-84f2e51175ea tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:32:10.303748 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-bd9c9c9d-f6c0-47ca-9ba6-84f2e51175ea tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:32:10.304517 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-bd9c9c9d-f6c0-47ca-9ba6-84f2e51175ea tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:32:10.304953 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-bd9c9c9d-f6c0-47ca-9ba6-84f2e51175ea tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:32:10.327968 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.objects.instance [None req-bd9c9c9d-f6c0-47ca-9ba6-84f2e51175ea tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lazy-loading 'flavor' on Instance uuid 2e3bce83-6dff-479d-a54c-8f660fbbcdc5 {{(pid=118477) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 05:32:10.405028 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-78833f04-2b66-40ef-a81f-9f1864745220 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:32:10.405525 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-78833f04-2b66-40ef-a81f-9f1864745220 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] [instance: 81874e0c-3350-44a3-8108-be514b727575] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:32:10.412558 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-78833f04-2b66-40ef-a81f-9f1864745220 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:32:10.413009 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-78833f04-2b66-40ef-a81f-9f1864745220 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:32:10.413797 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-78833f04-2b66-40ef-a81f-9f1864745220 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:32:10.414216 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-78833f04-2b66-40ef-a81f-9f1864745220 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:32:10.438388 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-78833f04-2b66-40ef-a81f-9f1864745220 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] 10.222.0.46 "GET /compute/v2.1/servers/81874e0c-3350-44a3-8108-be514b727575/ips" status: 200 len: 150 microversion: 2.1 time: 0.038086 Aug 04 05:32:10.444912 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 362/730] 10.222.0.46 () {58 vars in 1248 bytes} [Thu Aug 4 05:32:10 2022] GET /compute/v2.1/servers/81874e0c-3350-44a3-8108-be514b727575/ips => generated 150 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:32:10.822032 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-bd9c9c9d-f6c0-47ca-9ba6-84f2e51175ea tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] 10.222.0.46 "POST /compute/v2.1/servers/2e3bce83-6dff-479d-a54c-8f660fbbcdc5/action" status: 202 len: 0 microversion: 2.20 time: 0.530738 Aug 04 05:32:10.822660 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 369/731] 10.222.0.46 () {62 vars in 1319 bytes} [Thu Aug 4 05:32:10 2022] POST /compute/v2.1/servers/2e3bce83-6dff-479d-a54c-8f660fbbcdc5/action => generated 0 bytes in 532 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 04 05:32:10.836381 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-7b47ed32-200c-4408-ac62-312fcfe533d1 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:32:10.836381 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-7b47ed32-200c-4408-ac62-312fcfe533d1 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] [instance: 2e3bce83-6dff-479d-a54c-8f660fbbcdc5] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:32:10.839046 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-7b47ed32-200c-4408-ac62-312fcfe533d1 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:32:10.839492 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-7b47ed32-200c-4408-ac62-312fcfe533d1 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:32:10.840255 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-7b47ed32-200c-4408-ac62-312fcfe533d1 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:32:10.840724 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-7b47ed32-200c-4408-ac62-312fcfe533d1 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:32:11.011095 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-7b47ed32-200c-4408-ac62-312fcfe533d1 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:32:11.020082 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-7b47ed32-200c-4408-ac62-312fcfe533d1 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:32:11.021591 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-7b47ed32-200c-4408-ac62-312fcfe533d1 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:32:11.022923 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-7b47ed32-200c-4408-ac62-312fcfe533d1 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] 10.222.0.46 "GET /compute/v2.1/servers/2e3bce83-6dff-479d-a54c-8f660fbbcdc5" status: 200 len: 1724 microversion: 2.20 time: 0.195862 Aug 04 05:32:11.023493 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 363/732] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Aug 4 05:32:10 2022] GET /compute/v2.1/servers/2e3bce83-6dff-479d-a54c-8f660fbbcdc5 => generated 1724 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 05:32:12.051626 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-96191c90-ccdb-44da-a8f7-5c3880bea285 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:32:12.052372 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-96191c90-ccdb-44da-a8f7-5c3880bea285 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] [instance: 2e3bce83-6dff-479d-a54c-8f660fbbcdc5] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:32:12.061685 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-96191c90-ccdb-44da-a8f7-5c3880bea285 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:32:12.062122 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-96191c90-ccdb-44da-a8f7-5c3880bea285 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:32:12.062953 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-96191c90-ccdb-44da-a8f7-5c3880bea285 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:32:12.063645 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-96191c90-ccdb-44da-a8f7-5c3880bea285 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:32:12.070665 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-e60fd317-39cb-4820-b319-7772fdbcc286 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "897bde45-c855-42c7-a9e6-0ca7beef1380"}} {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:32:12.073063 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-e60fd317-39cb-4820-b319-7772fdbcc286 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] [instance: 81874e0c-3350-44a3-8108-be514b727575] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:32:12.080379 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-e60fd317-39cb-4820-b319-7772fdbcc286 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:32:12.080826 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-e60fd317-39cb-4820-b319-7772fdbcc286 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:32:12.081626 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-e60fd317-39cb-4820-b319-7772fdbcc286 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:32:12.082060 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-e60fd317-39cb-4820-b319-7772fdbcc286 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:32:12.200150 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-96191c90-ccdb-44da-a8f7-5c3880bea285 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:32:12.213610 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-96191c90-ccdb-44da-a8f7-5c3880bea285 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:32:12.215141 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-96191c90-ccdb-44da-a8f7-5c3880bea285 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:32:12.216443 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-96191c90-ccdb-44da-a8f7-5c3880bea285 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] 10.222.0.46 "GET /compute/v2.1/servers/2e3bce83-6dff-479d-a54c-8f660fbbcdc5" status: 200 len: 1724 microversion: 2.20 time: 0.169185 Aug 04 05:32:12.216996 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 370/733] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Aug 4 05:32:12 2022] GET /compute/v2.1/servers/2e3bce83-6dff-479d-a54c-8f660fbbcdc5 => generated 1724 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 05:32:12.900760 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-e60fd317-39cb-4820-b319-7772fdbcc286 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] 10.222.0.46 "POST /compute/v2.1/servers/81874e0c-3350-44a3-8108-be514b727575/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.833892 Aug 04 05:32:12.901518 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 364/734] 10.222.0.46 () {60 vars in 1323 bytes} [Thu Aug 4 05:32:12 2022] POST /compute/v2.1/servers/81874e0c-3350-44a3-8108-be514b727575/os-volume_attachments => generated 194 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 05:32:13.240895 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-adc333b9-5a14-4745-904a-bd1988f9a3cb tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:32:13.241770 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-adc333b9-5a14-4745-904a-bd1988f9a3cb tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] [instance: 2e3bce83-6dff-479d-a54c-8f660fbbcdc5] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:32:13.248493 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-adc333b9-5a14-4745-904a-bd1988f9a3cb tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:32:13.248935 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-adc333b9-5a14-4745-904a-bd1988f9a3cb tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:32:13.249692 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-adc333b9-5a14-4745-904a-bd1988f9a3cb tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:32:13.250115 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-adc333b9-5a14-4745-904a-bd1988f9a3cb tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:32:13.392432 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-adc333b9-5a14-4745-904a-bd1988f9a3cb tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:32:13.400656 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-adc333b9-5a14-4745-904a-bd1988f9a3cb tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:32:13.402217 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-adc333b9-5a14-4745-904a-bd1988f9a3cb tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:32:13.403402 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-adc333b9-5a14-4745-904a-bd1988f9a3cb tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] 10.222.0.46 "GET /compute/v2.1/servers/2e3bce83-6dff-479d-a54c-8f660fbbcdc5" status: 200 len: 1724 microversion: 2.20 time: 0.167491 Aug 04 05:32:13.404204 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 371/735] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Aug 4 05:32:13 2022] GET /compute/v2.1/servers/2e3bce83-6dff-479d-a54c-8f660fbbcdc5 => generated 1724 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 05:32:13.693272 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-a5f33261-007e-4ba0-ae04-69d1517b891e tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:32:13.695574 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-a5f33261-007e-4ba0-ae04-69d1517b891e tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] [instance: 938a0d12-9045-4220-b0ee-a4ed0a3c4b6a] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:32:13.701961 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-a5f33261-007e-4ba0-ae04-69d1517b891e tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:32:13.702442 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-a5f33261-007e-4ba0-ae04-69d1517b891e tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:32:13.703832 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-a5f33261-007e-4ba0-ae04-69d1517b891e tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:32:13.704209 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-a5f33261-007e-4ba0-ae04-69d1517b891e tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:32:13.737013 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-a5f33261-007e-4ba0-ae04-69d1517b891e tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] 10.222.0.46 "GET /compute/v2.1/servers/938a0d12-9045-4220-b0ee-a4ed0a3c4b6a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049266 Aug 04 05:32:13.737938 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 365/736] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Aug 4 05:32:13 2022] GET /compute/v2.1/servers/938a0d12-9045-4220-b0ee-a4ed0a3c4b6a/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:32:13.748895 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-0883f3e2-a584-47ca-8405-c2fa5be9370b tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:32:13.749727 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-0883f3e2-a584-47ca-8405-c2fa5be9370b tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] [instance: 938a0d12-9045-4220-b0ee-a4ed0a3c4b6a] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:32:13.756745 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-0883f3e2-a584-47ca-8405-c2fa5be9370b tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:32:13.757655 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-0883f3e2-a584-47ca-8405-c2fa5be9370b tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:32:13.758687 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-0883f3e2-a584-47ca-8405-c2fa5be9370b tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:32:13.759314 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-0883f3e2-a584-47ca-8405-c2fa5be9370b tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:32:13.791810 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-0883f3e2-a584-47ca-8405-c2fa5be9370b tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] 10.222.0.46 "GET /compute/v2.1/servers/938a0d12-9045-4220-b0ee-a4ed0a3c4b6a/os-volume_attachments/2cb60d25-54d1-4c7a-b368-37e80418efbe" status: 200 len: 194 microversion: 2.1 time: 0.046807 Aug 04 05:32:13.792390 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 372/737] 10.222.0.46 () {58 vars in 1413 bytes} [Thu Aug 4 05:32:13 2022] GET /compute/v2.1/servers/938a0d12-9045-4220-b0ee-a4ed0a3c4b6a/os-volume_attachments/2cb60d25-54d1-4c7a-b368-37e80418efbe => generated 194 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:32:14.427440 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-3b0d7436-3b94-48ce-baf1-78acdfa4c483 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:32:14.428189 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-3b0d7436-3b94-48ce-baf1-78acdfa4c483 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] [instance: 2e3bce83-6dff-479d-a54c-8f660fbbcdc5] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:32:14.434529 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-3b0d7436-3b94-48ce-baf1-78acdfa4c483 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:32:14.435056 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-3b0d7436-3b94-48ce-baf1-78acdfa4c483 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:32:14.436524 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-3b0d7436-3b94-48ce-baf1-78acdfa4c483 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:32:14.436524 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-3b0d7436-3b94-48ce-baf1-78acdfa4c483 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:32:14.574833 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-3b0d7436-3b94-48ce-baf1-78acdfa4c483 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:32:14.583471 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-3b0d7436-3b94-48ce-baf1-78acdfa4c483 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:32:14.584965 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-3b0d7436-3b94-48ce-baf1-78acdfa4c483 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:32:14.586109 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-3b0d7436-3b94-48ce-baf1-78acdfa4c483 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] 10.222.0.46 "GET /compute/v2.1/servers/2e3bce83-6dff-479d-a54c-8f660fbbcdc5" status: 200 len: 1724 microversion: 2.20 time: 0.162787 Aug 04 05:32:14.586706 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 366/738] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Aug 4 05:32:14 2022] GET /compute/v2.1/servers/2e3bce83-6dff-479d-a54c-8f660fbbcdc5 => generated 1724 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 05:32:15.516683 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-6645bae8-fc46-486b-acfe-e82f3f3557cd tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4e7f7fd4-192c-4efc-aa7a-1349ae52c3de"}} {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:32:15.519566 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-6645bae8-fc46-486b-acfe-e82f3f3557cd tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] [instance: 938a0d12-9045-4220-b0ee-a4ed0a3c4b6a] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:32:15.526069 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-6645bae8-fc46-486b-acfe-e82f3f3557cd tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:32:15.526553 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-6645bae8-fc46-486b-acfe-e82f3f3557cd tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:32:15.527405 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-6645bae8-fc46-486b-acfe-e82f3f3557cd tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:32:15.527740 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-6645bae8-fc46-486b-acfe-e82f3f3557cd tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:32:15.608960 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-94de1974-0baf-41a2-839c-6938f5c0155a tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:32:15.609566 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-94de1974-0baf-41a2-839c-6938f5c0155a tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] [instance: 2e3bce83-6dff-479d-a54c-8f660fbbcdc5] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:32:15.616542 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-94de1974-0baf-41a2-839c-6938f5c0155a tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:32:15.616986 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-94de1974-0baf-41a2-839c-6938f5c0155a tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:32:15.617741 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-94de1974-0baf-41a2-839c-6938f5c0155a tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:32:15.618163 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-94de1974-0baf-41a2-839c-6938f5c0155a tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:32:15.752537 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-94de1974-0baf-41a2-839c-6938f5c0155a tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:32:15.760931 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-94de1974-0baf-41a2-839c-6938f5c0155a tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:32:15.762461 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-94de1974-0baf-41a2-839c-6938f5c0155a tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:32:15.763610 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-94de1974-0baf-41a2-839c-6938f5c0155a tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] 10.222.0.46 "GET /compute/v2.1/servers/2e3bce83-6dff-479d-a54c-8f660fbbcdc5" status: 200 len: 1724 microversion: 2.20 time: 0.158569 Aug 04 05:32:15.764172 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 367/739] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Aug 4 05:32:15 2022] GET /compute/v2.1/servers/2e3bce83-6dff-479d-a54c-8f660fbbcdc5 => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 05:32:16.134362 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-6645bae8-fc46-486b-acfe-e82f3f3557cd tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] 10.222.0.46 "POST /compute/v2.1/servers/938a0d12-9045-4220-b0ee-a4ed0a3c4b6a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.621337 Aug 04 05:32:16.134976 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 373/740] 10.222.0.46 () {60 vars in 1323 bytes} [Thu Aug 4 05:32:15 2022] POST /compute/v2.1/servers/938a0d12-9045-4220-b0ee-a4ed0a3c4b6a/os-volume_attachments => generated 194 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:32:16.787816 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-26eda152-b871-4d10-a615-74a52e638c40 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:32:16.788342 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-26eda152-b871-4d10-a615-74a52e638c40 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] [instance: 2e3bce83-6dff-479d-a54c-8f660fbbcdc5] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:32:16.794950 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-26eda152-b871-4d10-a615-74a52e638c40 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:32:16.795476 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-26eda152-b871-4d10-a615-74a52e638c40 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:32:16.796248 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-26eda152-b871-4d10-a615-74a52e638c40 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:32:16.796684 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-26eda152-b871-4d10-a615-74a52e638c40 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:32:16.929373 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-26eda152-b871-4d10-a615-74a52e638c40 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:32:16.937627 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-26eda152-b871-4d10-a615-74a52e638c40 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:32:16.939165 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-26eda152-b871-4d10-a615-74a52e638c40 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:32:16.940349 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-26eda152-b871-4d10-a615-74a52e638c40 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] 10.222.0.46 "GET /compute/v2.1/servers/2e3bce83-6dff-479d-a54c-8f660fbbcdc5" status: 200 len: 1724 microversion: 2.20 time: 0.156672 Aug 04 05:32:16.940909 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 368/741] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Aug 4 05:32:16 2022] GET /compute/v2.1/servers/2e3bce83-6dff-479d-a54c-8f660fbbcdc5 => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 05:32:17.964068 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-c2f27f9a-c338-4bef-a59e-0255dc5ec032 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:32:17.964811 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-c2f27f9a-c338-4bef-a59e-0255dc5ec032 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] [instance: 2e3bce83-6dff-479d-a54c-8f660fbbcdc5] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:32:17.972590 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-c2f27f9a-c338-4bef-a59e-0255dc5ec032 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:32:17.973034 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-c2f27f9a-c338-4bef-a59e-0255dc5ec032 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:32:17.973833 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-c2f27f9a-c338-4bef-a59e-0255dc5ec032 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:32:17.974282 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-c2f27f9a-c338-4bef-a59e-0255dc5ec032 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:32:18.368260 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-c2f27f9a-c338-4bef-a59e-0255dc5ec032 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:32:18.376196 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-c2f27f9a-c338-4bef-a59e-0255dc5ec032 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:32:18.377907 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-c2f27f9a-c338-4bef-a59e-0255dc5ec032 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:32:18.379116 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-c2f27f9a-c338-4bef-a59e-0255dc5ec032 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] 10.222.0.46 "GET /compute/v2.1/servers/2e3bce83-6dff-479d-a54c-8f660fbbcdc5" status: 200 len: 1724 microversion: 2.20 time: 0.419563 Aug 04 05:32:18.379671 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 374/742] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Aug 4 05:32:17 2022] GET /compute/v2.1/servers/2e3bce83-6dff-479d-a54c-8f660fbbcdc5 => generated 1724 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 05:32:19.401341 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-e1790446-dab3-482a-8927-50d7f806ca70 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:32:19.401964 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-e1790446-dab3-482a-8927-50d7f806ca70 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] [instance: 2e3bce83-6dff-479d-a54c-8f660fbbcdc5] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:32:19.408738 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-e1790446-dab3-482a-8927-50d7f806ca70 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:32:19.409182 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-e1790446-dab3-482a-8927-50d7f806ca70 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:32:19.409939 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-e1790446-dab3-482a-8927-50d7f806ca70 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:32:19.410407 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-e1790446-dab3-482a-8927-50d7f806ca70 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:32:19.538962 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-e1790446-dab3-482a-8927-50d7f806ca70 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:32:19.546748 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-e1790446-dab3-482a-8927-50d7f806ca70 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:32:19.548260 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-e1790446-dab3-482a-8927-50d7f806ca70 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:32:19.550009 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-e1790446-dab3-482a-8927-50d7f806ca70 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] 10.222.0.46 "GET /compute/v2.1/servers/2e3bce83-6dff-479d-a54c-8f660fbbcdc5" status: 200 len: 1724 microversion: 2.20 time: 0.152550 Aug 04 05:32:19.550619 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 369/743] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Aug 4 05:32:19 2022] GET /compute/v2.1/servers/2e3bce83-6dff-479d-a54c-8f660fbbcdc5 => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 05:32:20.573089 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-636baecf-ab0f-4441-9d92-845cb2e77e61 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:32:20.573726 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-636baecf-ab0f-4441-9d92-845cb2e77e61 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] [instance: 2e3bce83-6dff-479d-a54c-8f660fbbcdc5] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:32:20.580374 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-636baecf-ab0f-4441-9d92-845cb2e77e61 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:32:20.580826 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-636baecf-ab0f-4441-9d92-845cb2e77e61 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:32:20.581545 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-636baecf-ab0f-4441-9d92-845cb2e77e61 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:32:20.581984 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-636baecf-ab0f-4441-9d92-845cb2e77e61 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:32:20.725271 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-636baecf-ab0f-4441-9d92-845cb2e77e61 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:32:20.733939 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-636baecf-ab0f-4441-9d92-845cb2e77e61 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:32:20.737001 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-636baecf-ab0f-4441-9d92-845cb2e77e61 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:32:20.737313 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-636baecf-ab0f-4441-9d92-845cb2e77e61 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] 10.222.0.46 "GET /compute/v2.1/servers/2e3bce83-6dff-479d-a54c-8f660fbbcdc5" status: 200 len: 1724 microversion: 2.20 time: 0.168189 Aug 04 05:32:20.738115 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 375/744] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Aug 4 05:32:20 2022] GET /compute/v2.1/servers/2e3bce83-6dff-479d-a54c-8f660fbbcdc5 => generated 1724 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 05:32:20.952139 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-a728acac-2df3-467c-bdad-dd980728dd8d tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:32:20.952668 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-a728acac-2df3-467c-bdad-dd980728dd8d tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] [instance: 81874e0c-3350-44a3-8108-be514b727575] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:32:20.959321 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-a728acac-2df3-467c-bdad-dd980728dd8d tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:32:20.959771 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-a728acac-2df3-467c-bdad-dd980728dd8d tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:32:20.960547 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-a728acac-2df3-467c-bdad-dd980728dd8d tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:32:20.960983 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-a728acac-2df3-467c-bdad-dd980728dd8d tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:32:21.047997 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.objects.instance [None req-a728acac-2df3-467c-bdad-dd980728dd8d tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lazy-loading 'services' on Instance uuid 81874e0c-3350-44a3-8108-be514b727575 {{(pid=118476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 05:32:21.243004 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-a728acac-2df3-467c-bdad-dd980728dd8d tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] 10.222.0.46 "DELETE /compute/v2.1/servers/81874e0c-3350-44a3-8108-be514b727575/os-volume_attachments/897bde45-c855-42c7-a9e6-0ca7beef1380" status: 202 len: 0 microversion: 2.1 time: 0.294622 Aug 04 05:32:21.243631 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 370/745] 10.222.0.46 () {58 vars in 1416 bytes} [Thu Aug 4 05:32:20 2022] DELETE /compute/v2.1/servers/81874e0c-3350-44a3-8108-be514b727575/os-volume_attachments/897bde45-c855-42c7-a9e6-0ca7beef1380 => generated 0 bytes in 296 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 05:32:21.252880 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-ec05ae78-e4fa-4b21-ae16-c380b6ccade1 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:32:21.255475 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-ec05ae78-e4fa-4b21-ae16-c380b6ccade1 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] [instance: 81874e0c-3350-44a3-8108-be514b727575] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:32:21.261956 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-ec05ae78-e4fa-4b21-ae16-c380b6ccade1 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:32:21.262436 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-ec05ae78-e4fa-4b21-ae16-c380b6ccade1 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:32:21.263200 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-ec05ae78-e4fa-4b21-ae16-c380b6ccade1 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:32:21.263635 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-ec05ae78-e4fa-4b21-ae16-c380b6ccade1 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:32:21.293840 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-ec05ae78-e4fa-4b21-ae16-c380b6ccade1 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] 10.222.0.46 "GET /compute/v2.1/servers/81874e0c-3350-44a3-8108-be514b727575/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045696 Aug 04 05:32:21.294415 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 376/746] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Aug 4 05:32:21 2022] GET /compute/v2.1/servers/81874e0c-3350-44a3-8108-be514b727575/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:32:21.761641 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-09fb5ffb-e4ef-4b3a-9136-549b3ffe9e11 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:32:21.762235 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-09fb5ffb-e4ef-4b3a-9136-549b3ffe9e11 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] [instance: 2e3bce83-6dff-479d-a54c-8f660fbbcdc5] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:32:21.769153 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-09fb5ffb-e4ef-4b3a-9136-549b3ffe9e11 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:32:21.769597 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-09fb5ffb-e4ef-4b3a-9136-549b3ffe9e11 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:32:21.770382 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-09fb5ffb-e4ef-4b3a-9136-549b3ffe9e11 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:32:21.770817 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-09fb5ffb-e4ef-4b3a-9136-549b3ffe9e11 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:32:21.902138 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-09fb5ffb-e4ef-4b3a-9136-549b3ffe9e11 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:32:21.910427 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-09fb5ffb-e4ef-4b3a-9136-549b3ffe9e11 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:32:21.911941 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-09fb5ffb-e4ef-4b3a-9136-549b3ffe9e11 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:32:21.913089 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-09fb5ffb-e4ef-4b3a-9136-549b3ffe9e11 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] 10.222.0.46 "GET /compute/v2.1/servers/2e3bce83-6dff-479d-a54c-8f660fbbcdc5" status: 200 len: 1724 microversion: 2.20 time: 0.156089 Aug 04 05:32:21.913654 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 371/747] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Aug 4 05:32:21 2022] GET /compute/v2.1/servers/2e3bce83-6dff-479d-a54c-8f660fbbcdc5 => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 05:32:22.306676 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-654b8d76-d136-4e17-8fa2-e87e7b55560a tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:32:22.309059 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-654b8d76-d136-4e17-8fa2-e87e7b55560a tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] [instance: 81874e0c-3350-44a3-8108-be514b727575] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:32:22.316751 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-654b8d76-d136-4e17-8fa2-e87e7b55560a tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:32:22.317192 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-654b8d76-d136-4e17-8fa2-e87e7b55560a tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:32:22.317945 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-654b8d76-d136-4e17-8fa2-e87e7b55560a tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:32:22.318401 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-654b8d76-d136-4e17-8fa2-e87e7b55560a tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:32:22.349889 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-654b8d76-d136-4e17-8fa2-e87e7b55560a tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] 10.222.0.46 "GET /compute/v2.1/servers/81874e0c-3350-44a3-8108-be514b727575/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047503 Aug 04 05:32:22.350465 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 377/748] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Aug 4 05:32:22 2022] GET /compute/v2.1/servers/81874e0c-3350-44a3-8108-be514b727575/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:32:22.935480 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-f72d5428-3f4f-43fd-bd99-a9bb8c6aee5e tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:32:22.936066 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-f72d5428-3f4f-43fd-bd99-a9bb8c6aee5e tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] [instance: 2e3bce83-6dff-479d-a54c-8f660fbbcdc5] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:32:22.942833 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-f72d5428-3f4f-43fd-bd99-a9bb8c6aee5e tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:32:22.943278 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-f72d5428-3f4f-43fd-bd99-a9bb8c6aee5e tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:32:22.944042 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-f72d5428-3f4f-43fd-bd99-a9bb8c6aee5e tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:32:22.944479 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-f72d5428-3f4f-43fd-bd99-a9bb8c6aee5e tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:32:23.078042 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-f72d5428-3f4f-43fd-bd99-a9bb8c6aee5e tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:32:23.086645 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-f72d5428-3f4f-43fd-bd99-a9bb8c6aee5e tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:32:23.088157 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-f72d5428-3f4f-43fd-bd99-a9bb8c6aee5e tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:32:23.089312 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-f72d5428-3f4f-43fd-bd99-a9bb8c6aee5e tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] 10.222.0.46 "GET /compute/v2.1/servers/2e3bce83-6dff-479d-a54c-8f660fbbcdc5" status: 200 len: 1724 microversion: 2.20 time: 0.157785 Aug 04 05:32:23.089877 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 372/749] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Aug 4 05:32:22 2022] GET /compute/v2.1/servers/2e3bce83-6dff-479d-a54c-8f660fbbcdc5 => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 05:32:23.362814 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-9f72bd17-9fe0-4408-8f82-f1f6be9fcd6b tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:32:23.364830 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-9f72bd17-9fe0-4408-8f82-f1f6be9fcd6b tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] [instance: 81874e0c-3350-44a3-8108-be514b727575] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:32:23.371643 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-9f72bd17-9fe0-4408-8f82-f1f6be9fcd6b tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:32:23.372082 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-9f72bd17-9fe0-4408-8f82-f1f6be9fcd6b tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:32:23.372839 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-9f72bd17-9fe0-4408-8f82-f1f6be9fcd6b tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:32:23.373265 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-9f72bd17-9fe0-4408-8f82-f1f6be9fcd6b tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:32:23.402259 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-9f72bd17-9fe0-4408-8f82-f1f6be9fcd6b tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] 10.222.0.46 "GET /compute/v2.1/servers/81874e0c-3350-44a3-8108-be514b727575/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044096 Aug 04 05:32:23.402850 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 378/750] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Aug 4 05:32:23 2022] GET /compute/v2.1/servers/81874e0c-3350-44a3-8108-be514b727575/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:32:24.113824 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-a17af058-7ea6-4076-9225-83b9050c95b2 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:32:24.114452 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-a17af058-7ea6-4076-9225-83b9050c95b2 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] [instance: 2e3bce83-6dff-479d-a54c-8f660fbbcdc5] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:32:24.120948 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-a17af058-7ea6-4076-9225-83b9050c95b2 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:32:24.121388 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-a17af058-7ea6-4076-9225-83b9050c95b2 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:32:24.122153 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-a17af058-7ea6-4076-9225-83b9050c95b2 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:32:24.122616 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-a17af058-7ea6-4076-9225-83b9050c95b2 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:32:24.256973 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-a17af058-7ea6-4076-9225-83b9050c95b2 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:32:24.264953 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-a17af058-7ea6-4076-9225-83b9050c95b2 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:32:24.266482 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-a17af058-7ea6-4076-9225-83b9050c95b2 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:32:24.268329 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-a17af058-7ea6-4076-9225-83b9050c95b2 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] 10.222.0.46 "GET /compute/v2.1/servers/2e3bce83-6dff-479d-a54c-8f660fbbcdc5" status: 200 len: 1724 microversion: 2.20 time: 0.159085 Aug 04 05:32:24.268918 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 373/751] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Aug 4 05:32:24 2022] GET /compute/v2.1/servers/2e3bce83-6dff-479d-a54c-8f660fbbcdc5 => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 05:32:24.414219 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-ed5bfdbd-c712-44c5-8a4d-a422d562217c tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:32:24.416394 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-ed5bfdbd-c712-44c5-8a4d-a422d562217c tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] [instance: 81874e0c-3350-44a3-8108-be514b727575] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:32:24.422770 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-ed5bfdbd-c712-44c5-8a4d-a422d562217c tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:32:24.423214 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-ed5bfdbd-c712-44c5-8a4d-a422d562217c tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:32:24.424078 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-ed5bfdbd-c712-44c5-8a4d-a422d562217c tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:32:24.424503 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-ed5bfdbd-c712-44c5-8a4d-a422d562217c tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:32:24.449025 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG dbcounter [-] [118477] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=6,nova_cell1:INSERT=3 {{(pid=118477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:32:24.453369 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-ed5bfdbd-c712-44c5-8a4d-a422d562217c tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] 10.222.0.46 "GET /compute/v2.1/servers/81874e0c-3350-44a3-8108-be514b727575/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043108 Aug 04 05:32:24.453924 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 379/752] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Aug 4 05:32:24 2022] GET /compute/v2.1/servers/81874e0c-3350-44a3-8108-be514b727575/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:32:25.292143 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-517e1931-0d61-4fd4-97ce-8a6a944f0620 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:32:25.292751 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-517e1931-0d61-4fd4-97ce-8a6a944f0620 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] [instance: 2e3bce83-6dff-479d-a54c-8f660fbbcdc5] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:32:25.299595 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-517e1931-0d61-4fd4-97ce-8a6a944f0620 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:32:25.300038 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-517e1931-0d61-4fd4-97ce-8a6a944f0620 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:32:25.300795 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-517e1931-0d61-4fd4-97ce-8a6a944f0620 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:32:25.301227 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-517e1931-0d61-4fd4-97ce-8a6a944f0620 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:32:25.429716 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-517e1931-0d61-4fd4-97ce-8a6a944f0620 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:32:25.437522 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-517e1931-0d61-4fd4-97ce-8a6a944f0620 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:32:25.439086 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-517e1931-0d61-4fd4-97ce-8a6a944f0620 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:32:25.440236 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-517e1931-0d61-4fd4-97ce-8a6a944f0620 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] 10.222.0.46 "GET /compute/v2.1/servers/2e3bce83-6dff-479d-a54c-8f660fbbcdc5" status: 200 len: 1724 microversion: 2.20 time: 0.152001 Aug 04 05:32:25.440807 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 374/753] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Aug 4 05:32:25 2022] GET /compute/v2.1/servers/2e3bce83-6dff-479d-a54c-8f660fbbcdc5 => generated 1724 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 05:32:25.466381 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-fab0170b-d54a-42a7-be43-24bcecfc8c32 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:32:25.468562 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-fab0170b-d54a-42a7-be43-24bcecfc8c32 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] [instance: 81874e0c-3350-44a3-8108-be514b727575] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:32:25.477327 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-fab0170b-d54a-42a7-be43-24bcecfc8c32 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:32:25.477768 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-fab0170b-d54a-42a7-be43-24bcecfc8c32 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:32:25.478557 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-fab0170b-d54a-42a7-be43-24bcecfc8c32 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:32:25.489491 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-fab0170b-d54a-42a7-be43-24bcecfc8c32 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:32:25.508125 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-fab0170b-d54a-42a7-be43-24bcecfc8c32 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] 10.222.0.46 "GET /compute/v2.1/servers/81874e0c-3350-44a3-8108-be514b727575/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045752 Aug 04 05:32:25.508681 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 380/754] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Aug 4 05:32:25 2022] GET /compute/v2.1/servers/81874e0c-3350-44a3-8108-be514b727575/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:32:26.463640 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-6fee9bde-bbb0-40be-9157-4520b74c7334 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:32:26.464241 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-6fee9bde-bbb0-40be-9157-4520b74c7334 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] [instance: 2e3bce83-6dff-479d-a54c-8f660fbbcdc5] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:32:26.471259 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-6fee9bde-bbb0-40be-9157-4520b74c7334 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:32:26.471729 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-6fee9bde-bbb0-40be-9157-4520b74c7334 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:32:26.472490 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-6fee9bde-bbb0-40be-9157-4520b74c7334 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:32:26.472943 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-6fee9bde-bbb0-40be-9157-4520b74c7334 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:32:26.491654 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG dbcounter [-] [118476] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=118476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:32:26.520278 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-85545b94-3090-4dff-89a1-1e4c5e293e60 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:32:26.522432 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-85545b94-3090-4dff-89a1-1e4c5e293e60 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] [instance: 81874e0c-3350-44a3-8108-be514b727575] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:32:26.530002 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-85545b94-3090-4dff-89a1-1e4c5e293e60 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:32:26.530505 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-85545b94-3090-4dff-89a1-1e4c5e293e60 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:32:26.531249 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-85545b94-3090-4dff-89a1-1e4c5e293e60 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:32:26.531676 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-85545b94-3090-4dff-89a1-1e4c5e293e60 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:32:26.562611 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-85545b94-3090-4dff-89a1-1e4c5e293e60 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] 10.222.0.46 "GET /compute/v2.1/servers/81874e0c-3350-44a3-8108-be514b727575/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046151 Aug 04 05:32:26.563188 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 381/755] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Aug 4 05:32:26 2022] GET /compute/v2.1/servers/81874e0c-3350-44a3-8108-be514b727575/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 05:32:26.612215 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-6fee9bde-bbb0-40be-9157-4520b74c7334 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:32:26.620214 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-6fee9bde-bbb0-40be-9157-4520b74c7334 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:32:26.627292 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-6fee9bde-bbb0-40be-9157-4520b74c7334 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:32:26.627292 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-6fee9bde-bbb0-40be-9157-4520b74c7334 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] 10.222.0.46 "GET /compute/v2.1/servers/2e3bce83-6dff-479d-a54c-8f660fbbcdc5" status: 200 len: 1724 microversion: 2.20 time: 0.163413 Aug 04 05:32:26.627292 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 375/756] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Aug 4 05:32:26 2022] GET /compute/v2.1/servers/2e3bce83-6dff-479d-a54c-8f660fbbcdc5 => generated 1724 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 05:32:27.574988 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-839f6581-8df0-4a64-b4f4-dae824d8a890 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:32:27.577118 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-839f6581-8df0-4a64-b4f4-dae824d8a890 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] [instance: 81874e0c-3350-44a3-8108-be514b727575] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:32:27.583826 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-839f6581-8df0-4a64-b4f4-dae824d8a890 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:32:27.584273 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-839f6581-8df0-4a64-b4f4-dae824d8a890 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:32:27.585031 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-839f6581-8df0-4a64-b4f4-dae824d8a890 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:32:27.585464 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-839f6581-8df0-4a64-b4f4-dae824d8a890 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:32:27.614371 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-839f6581-8df0-4a64-b4f4-dae824d8a890 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] 10.222.0.46 "GET /compute/v2.1/servers/81874e0c-3350-44a3-8108-be514b727575/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043312 Aug 04 05:32:27.614923 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 382/757] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Aug 4 05:32:27 2022] GET /compute/v2.1/servers/81874e0c-3350-44a3-8108-be514b727575/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:32:27.648555 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-8350cbdf-aa4b-41a3-bdf2-e0db77d08084 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:32:27.649243 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-8350cbdf-aa4b-41a3-bdf2-e0db77d08084 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] [instance: 2e3bce83-6dff-479d-a54c-8f660fbbcdc5] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:32:27.656090 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-8350cbdf-aa4b-41a3-bdf2-e0db77d08084 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:32:27.656522 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-8350cbdf-aa4b-41a3-bdf2-e0db77d08084 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:32:27.657289 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-8350cbdf-aa4b-41a3-bdf2-e0db77d08084 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:32:27.657741 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-8350cbdf-aa4b-41a3-bdf2-e0db77d08084 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:32:27.796463 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-8350cbdf-aa4b-41a3-bdf2-e0db77d08084 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:32:27.805287 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-8350cbdf-aa4b-41a3-bdf2-e0db77d08084 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:32:27.806901 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-8350cbdf-aa4b-41a3-bdf2-e0db77d08084 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:32:27.808065 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-8350cbdf-aa4b-41a3-bdf2-e0db77d08084 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] 10.222.0.46 "GET /compute/v2.1/servers/2e3bce83-6dff-479d-a54c-8f660fbbcdc5" status: 200 len: 1745 microversion: 2.20 time: 0.163394 Aug 04 05:32:27.808668 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 376/758] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Aug 4 05:32:27 2022] GET /compute/v2.1/servers/2e3bce83-6dff-479d-a54c-8f660fbbcdc5 => generated 1745 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 05:32:28.627065 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-5710e6d5-a2bf-4b31-84f5-6a130ea3ac3c tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:32:28.629221 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-5710e6d5-a2bf-4b31-84f5-6a130ea3ac3c tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] [instance: 81874e0c-3350-44a3-8108-be514b727575] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:32:28.635826 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-5710e6d5-a2bf-4b31-84f5-6a130ea3ac3c tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:32:28.636269 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-5710e6d5-a2bf-4b31-84f5-6a130ea3ac3c tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:32:28.637029 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-5710e6d5-a2bf-4b31-84f5-6a130ea3ac3c tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:32:28.637462 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-5710e6d5-a2bf-4b31-84f5-6a130ea3ac3c tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:32:28.669851 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-5710e6d5-a2bf-4b31-84f5-6a130ea3ac3c tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] 10.222.0.46 "GET /compute/v2.1/servers/81874e0c-3350-44a3-8108-be514b727575/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047295 Aug 04 05:32:28.670749 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 383/759] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Aug 4 05:32:28 2022] GET /compute/v2.1/servers/81874e0c-3350-44a3-8108-be514b727575/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:32:28.833507 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-a6c0f360-2b09-46aa-aab4-bc92670453d2 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:32:28.834115 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-a6c0f360-2b09-46aa-aab4-bc92670453d2 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] [instance: 2e3bce83-6dff-479d-a54c-8f660fbbcdc5] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:32:28.840749 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-a6c0f360-2b09-46aa-aab4-bc92670453d2 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:32:28.841293 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-a6c0f360-2b09-46aa-aab4-bc92670453d2 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:32:28.841936 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-a6c0f360-2b09-46aa-aab4-bc92670453d2 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:32:28.842398 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-a6c0f360-2b09-46aa-aab4-bc92670453d2 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:32:28.974457 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-45cc1da2-fe01-4520-a177-a2276f303c95 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:32:28.976630 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-45cc1da2-fe01-4520-a177-a2276f303c95 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] [instance: 938a0d12-9045-4220-b0ee-a4ed0a3c4b6a] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:32:28.982929 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-45cc1da2-fe01-4520-a177-a2276f303c95 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:32:28.983374 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-45cc1da2-fe01-4520-a177-a2276f303c95 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:32:28.984139 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-45cc1da2-fe01-4520-a177-a2276f303c95 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:32:28.984569 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-45cc1da2-fe01-4520-a177-a2276f303c95 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:32:28.993166 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-a6c0f360-2b09-46aa-aab4-bc92670453d2 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:32:29.001225 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-a6c0f360-2b09-46aa-aab4-bc92670453d2 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:32:29.002939 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-a6c0f360-2b09-46aa-aab4-bc92670453d2 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:32:29.004114 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-a6c0f360-2b09-46aa-aab4-bc92670453d2 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] 10.222.0.46 "GET /compute/v2.1/servers/2e3bce83-6dff-479d-a54c-8f660fbbcdc5" status: 200 len: 1745 microversion: 2.20 time: 0.175455 Aug 04 05:32:29.004680 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 377/760] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Aug 4 05:32:28 2022] GET /compute/v2.1/servers/2e3bce83-6dff-479d-a54c-8f660fbbcdc5 => generated 1745 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 05:32:29.021296 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-45cc1da2-fe01-4520-a177-a2276f303c95 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] 10.222.0.46 "GET /compute/v2.1/servers/938a0d12-9045-4220-b0ee-a4ed0a3c4b6a/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.051800 Aug 04 05:32:29.021967 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 384/761] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Aug 4 05:32:28 2022] GET /compute/v2.1/servers/938a0d12-9045-4220-b0ee-a4ed0a3c4b6a/os-volume_attachments => generated 371 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 05:32:29.168500 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-9f8cfecd-cca4-4942-ac77-212df627c80c tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:32:29.168907 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-9f8cfecd-cca4-4942-ac77-212df627c80c tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] [instance: 938a0d12-9045-4220-b0ee-a4ed0a3c4b6a] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:32:29.176242 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-9f8cfecd-cca4-4942-ac77-212df627c80c tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:32:29.176686 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-9f8cfecd-cca4-4942-ac77-212df627c80c tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:32:29.177454 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-9f8cfecd-cca4-4942-ac77-212df627c80c tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:32:29.177881 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-9f8cfecd-cca4-4942-ac77-212df627c80c tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:32:29.208502 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-9f8cfecd-cca4-4942-ac77-212df627c80c tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] 10.222.0.46 "GET /compute/v2.1/servers/938a0d12-9045-4220-b0ee-a4ed0a3c4b6a/os-volume_attachments/2cb60d25-54d1-4c7a-b368-37e80418efbe" status: 200 len: 194 microversion: 2.1 time: 0.044034 Aug 04 05:32:29.209109 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 378/762] 10.222.0.46 () {58 vars in 1413 bytes} [Thu Aug 4 05:32:29 2022] GET /compute/v2.1/servers/938a0d12-9045-4220-b0ee-a4ed0a3c4b6a/os-volume_attachments/2cb60d25-54d1-4c7a-b368-37e80418efbe => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:32:29.228476 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-ced3394c-ee55-4312-acf5-566fb7923f4d tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:32:29.228969 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-ced3394c-ee55-4312-acf5-566fb7923f4d tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] [instance: 938a0d12-9045-4220-b0ee-a4ed0a3c4b6a] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:32:29.235351 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-ced3394c-ee55-4312-acf5-566fb7923f4d tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:32:29.239769 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-ced3394c-ee55-4312-acf5-566fb7923f4d tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:32:29.239769 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-ced3394c-ee55-4312-acf5-566fb7923f4d tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:32:29.239769 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-ced3394c-ee55-4312-acf5-566fb7923f4d tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:32:29.327219 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.objects.instance [None req-ced3394c-ee55-4312-acf5-566fb7923f4d tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lazy-loading 'services' on Instance uuid 938a0d12-9045-4220-b0ee-a4ed0a3c4b6a {{(pid=118477) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 05:32:29.540072 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-ced3394c-ee55-4312-acf5-566fb7923f4d tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] 10.222.0.46 "DELETE /compute/v2.1/servers/938a0d12-9045-4220-b0ee-a4ed0a3c4b6a/os-volume_attachments/2cb60d25-54d1-4c7a-b368-37e80418efbe" status: 202 len: 0 microversion: 2.1 time: 0.315381 Aug 04 05:32:29.543207 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 385/763] 10.222.0.46 () {58 vars in 1416 bytes} [Thu Aug 4 05:32:29 2022] DELETE /compute/v2.1/servers/938a0d12-9045-4220-b0ee-a4ed0a3c4b6a/os-volume_attachments/2cb60d25-54d1-4c7a-b368-37e80418efbe => generated 0 bytes in 317 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 05:32:29.683518 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-2ab49660-e20d-42cf-817c-ce8917ab9a9f tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:32:29.686015 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-2ab49660-e20d-42cf-817c-ce8917ab9a9f tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] [instance: 81874e0c-3350-44a3-8108-be514b727575] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:32:29.693232 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-2ab49660-e20d-42cf-817c-ce8917ab9a9f tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:32:29.693694 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-2ab49660-e20d-42cf-817c-ce8917ab9a9f tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:32:29.694589 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-2ab49660-e20d-42cf-817c-ce8917ab9a9f tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:32:29.695030 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-2ab49660-e20d-42cf-817c-ce8917ab9a9f tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:32:29.725937 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-2ab49660-e20d-42cf-817c-ce8917ab9a9f tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] 10.222.0.46 "GET /compute/v2.1/servers/81874e0c-3350-44a3-8108-be514b727575/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047756 Aug 04 05:32:29.726882 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 379/764] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Aug 4 05:32:29 2022] GET /compute/v2.1/servers/81874e0c-3350-44a3-8108-be514b727575/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 05:32:29.797639 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-709f337d-660f-44f2-b23c-7bb19373f924 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:32:29.798238 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-709f337d-660f-44f2-b23c-7bb19373f924 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] [instance: 81874e0c-3350-44a3-8108-be514b727575] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:32:29.805156 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-709f337d-660f-44f2-b23c-7bb19373f924 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:32:29.805608 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-709f337d-660f-44f2-b23c-7bb19373f924 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:32:29.806501 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-709f337d-660f-44f2-b23c-7bb19373f924 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:32:29.806975 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-709f337d-660f-44f2-b23c-7bb19373f924 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:32:29.835720 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-709f337d-660f-44f2-b23c-7bb19373f924 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] [instance: 81874e0c-3350-44a3-8108-be514b727575] Going to try to terminate instance {{(pid=118477) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 05:32:30.027961 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-691a9430-2ba8-42d1-b2a0-475ed55282b4 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:32:30.028465 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-691a9430-2ba8-42d1-b2a0-475ed55282b4 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] [instance: 2e3bce83-6dff-479d-a54c-8f660fbbcdc5] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:32:30.036628 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-691a9430-2ba8-42d1-b2a0-475ed55282b4 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:32:30.037105 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-691a9430-2ba8-42d1-b2a0-475ed55282b4 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:32:30.037858 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-691a9430-2ba8-42d1-b2a0-475ed55282b4 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:32:30.038289 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-691a9430-2ba8-42d1-b2a0-475ed55282b4 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:32:30.131286 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-709f337d-660f-44f2-b23c-7bb19373f924 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] 10.222.0.46 "DELETE /compute/v2.1/servers/81874e0c-3350-44a3-8108-be514b727575" status: 204 len: 0 microversion: 2.1 time: 0.325243 Aug 04 05:32:30.131286 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 386/765] 10.222.0.46 () {58 vars in 1239 bytes} [Thu Aug 4 05:32:29 2022] DELETE /compute/v2.1/servers/81874e0c-3350-44a3-8108-be514b727575 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 05:32:30.131286 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-10991d09-7629-40b9-a15b-6794fc57f0ed tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:32:30.131286 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-10991d09-7629-40b9-a15b-6794fc57f0ed tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] [instance: 81874e0c-3350-44a3-8108-be514b727575] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:32:30.137935 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-10991d09-7629-40b9-a15b-6794fc57f0ed tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:32:30.138603 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-10991d09-7629-40b9-a15b-6794fc57f0ed tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:32:30.139538 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-10991d09-7629-40b9-a15b-6794fc57f0ed tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:32:30.143395 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-10991d09-7629-40b9-a15b-6794fc57f0ed tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:32:30.212549 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-691a9430-2ba8-42d1-b2a0-475ed55282b4 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:32:30.222233 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-691a9430-2ba8-42d1-b2a0-475ed55282b4 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:32:30.223791 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-691a9430-2ba8-42d1-b2a0-475ed55282b4 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:32:30.224959 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-691a9430-2ba8-42d1-b2a0-475ed55282b4 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] 10.222.0.46 "GET /compute/v2.1/servers/2e3bce83-6dff-479d-a54c-8f660fbbcdc5" status: 200 len: 1740 microversion: 2.20 time: 0.201264 Aug 04 05:32:30.225589 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 380/766] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Aug 4 05:32:30 2022] GET /compute/v2.1/servers/2e3bce83-6dff-479d-a54c-8f660fbbcdc5 => generated 1740 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 05:32:30.318215 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-10991d09-7629-40b9-a15b-6794fc57f0ed tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb49b631c234f9a9fd47049b9b2e097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faead990837d43de8ec54bfaf24361de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:32:30.328709 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-10991d09-7629-40b9-a15b-6794fc57f0ed tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] 10.222.0.46 "GET /compute/v2.1/servers/81874e0c-3350-44a3-8108-be514b727575" status: 200 len: 1681 microversion: 2.1 time: 0.205465 Aug 04 05:32:30.329644 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 387/767] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:32:30 2022] GET /compute/v2.1/servers/81874e0c-3350-44a3-8108-be514b727575 => generated 1681 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 05:32:31.254121 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-b3422181-afa2-4069-aeef-45e43cf1d079 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:32:31.255713 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-b3422181-afa2-4069-aeef-45e43cf1d079 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] [instance: 2e3bce83-6dff-479d-a54c-8f660fbbcdc5] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:32:31.262871 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-b3422181-afa2-4069-aeef-45e43cf1d079 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:32:31.263743 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-b3422181-afa2-4069-aeef-45e43cf1d079 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:32:31.264977 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-b3422181-afa2-4069-aeef-45e43cf1d079 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:32:31.265618 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-b3422181-afa2-4069-aeef-45e43cf1d079 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:32:31.353240 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-9e1558f2-9b50-4224-bbba-b095311c8075 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:32:31.355080 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-9e1558f2-9b50-4224-bbba-b095311c8075 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] [instance: 81874e0c-3350-44a3-8108-be514b727575] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:32:31.368655 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-9e1558f2-9b50-4224-bbba-b095311c8075 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:32:31.369447 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-9e1558f2-9b50-4224-bbba-b095311c8075 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:32:31.370466 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-9e1558f2-9b50-4224-bbba-b095311c8075 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:32:31.371087 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-9e1558f2-9b50-4224-bbba-b095311c8075 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:32:31.560974 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-b3422181-afa2-4069-aeef-45e43cf1d079 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:32:31.575469 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-b3422181-afa2-4069-aeef-45e43cf1d079 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:32:31.577353 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-b3422181-afa2-4069-aeef-45e43cf1d079 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:32:31.578816 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-b3422181-afa2-4069-aeef-45e43cf1d079 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] 10.222.0.46 "GET /compute/v2.1/servers/2e3bce83-6dff-479d-a54c-8f660fbbcdc5" status: 200 len: 1740 microversion: 2.20 time: 0.333223 Aug 04 05:32:31.580514 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 381/768] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Aug 4 05:32:31 2022] GET /compute/v2.1/servers/2e3bce83-6dff-479d-a54c-8f660fbbcdc5 => generated 1740 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 05:32:31.590237 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [req-606d2393-382c-4067-b77b-ad6ded46eb61 req-fdeaca0f-5d8f-4c6e-b426-234168bc2a02 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e3bce83-6dff-479d-a54c-8f660fbbcdc5", "name": "network-vif-plugged", "status": "completed", "tag": "ddeaefd6-9468-4764-8ef0-df45fd5ea8db"}]} {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:32:31.590411 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-9e1558f2-9b50-4224-bbba-b095311c8075 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb49b631c234f9a9fd47049b9b2e097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faead990837d43de8ec54bfaf24361de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:32:31.600368 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-9e1558f2-9b50-4224-bbba-b095311c8075 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] 10.222.0.46 "GET /compute/v2.1/servers/81874e0c-3350-44a3-8108-be514b727575" status: 200 len: 1681 microversion: 2.1 time: 0.251083 Aug 04 05:32:31.602522 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [req-606d2393-382c-4067-b77b-ad6ded46eb61 req-fdeaca0f-5d8f-4c6e-b426-234168bc2a02 service nova] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:32:31.603273 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [req-606d2393-382c-4067-b77b-ad6ded46eb61 req-fdeaca0f-5d8f-4c6e-b426-234168bc2a02 service nova] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:32:31.605774 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 388/769] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:32:31 2022] GET /compute/v2.1/servers/81874e0c-3350-44a3-8108-be514b727575 => generated 1681 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 05:32:31.616737 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.compute.server_external_events [req-606d2393-382c-4067-b77b-ad6ded46eb61 req-fdeaca0f-5d8f-4c6e-b426-234168bc2a02 service nova] Creating event network-vif-plugged:ddeaefd6-9468-4764-8ef0-df45fd5ea8db for instance 2e3bce83-6dff-479d-a54c-8f660fbbcdc5 on hv-cinder-85207 Aug 04 05:32:31.628436 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [req-606d2393-382c-4067-b77b-ad6ded46eb61 req-fdeaca0f-5d8f-4c6e-b426-234168bc2a02 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044411 Aug 04 05:32:31.628436 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 382/770] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Aug 4 05:32:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:32:32.603926 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-65d157e4-5512-489b-b5ba-8f45cf70d3ed tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:32:32.605048 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-65d157e4-5512-489b-b5ba-8f45cf70d3ed tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] [instance: 2e3bce83-6dff-479d-a54c-8f660fbbcdc5] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:32:32.614769 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-65d157e4-5512-489b-b5ba-8f45cf70d3ed tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:32:32.615512 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-65d157e4-5512-489b-b5ba-8f45cf70d3ed tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:32:32.616376 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-65d157e4-5512-489b-b5ba-8f45cf70d3ed tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:32:32.616853 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-65d157e4-5512-489b-b5ba-8f45cf70d3ed tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:32:32.630911 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-d3823aa9-e5b9-4fec-b772-f22a60d8a4dc tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:32:32.631779 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-d3823aa9-e5b9-4fec-b772-f22a60d8a4dc tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] [instance: 81874e0c-3350-44a3-8108-be514b727575] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:32:32.641291 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-d3823aa9-e5b9-4fec-b772-f22a60d8a4dc tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:32:32.644018 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-d3823aa9-e5b9-4fec-b772-f22a60d8a4dc tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:32:32.646547 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-d3823aa9-e5b9-4fec-b772-f22a60d8a4dc tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:32:32.647081 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-d3823aa9-e5b9-4fec-b772-f22a60d8a4dc tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:32:32.946707 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-65d157e4-5512-489b-b5ba-8f45cf70d3ed tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:32:32.955845 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-65d157e4-5512-489b-b5ba-8f45cf70d3ed tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:32:32.957377 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-65d157e4-5512-489b-b5ba-8f45cf70d3ed tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:32:32.958617 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-65d157e4-5512-489b-b5ba-8f45cf70d3ed tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] 10.222.0.46 "GET /compute/v2.1/servers/2e3bce83-6dff-479d-a54c-8f660fbbcdc5" status: 200 len: 1740 microversion: 2.20 time: 0.359131 Aug 04 05:32:32.959197 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 389/771] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Aug 4 05:32:32 2022] GET /compute/v2.1/servers/2e3bce83-6dff-479d-a54c-8f660fbbcdc5 => generated 1740 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 05:32:32.963740 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-0e065f4e-c396-4a8c-afd1-dda7414ada9b tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:32:32.964224 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-0e065f4e-c396-4a8c-afd1-dda7414ada9b tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] [instance: 938a0d12-9045-4220-b0ee-a4ed0a3c4b6a] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:32:32.971251 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-0e065f4e-c396-4a8c-afd1-dda7414ada9b tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:32:32.971700 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-0e065f4e-c396-4a8c-afd1-dda7414ada9b tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:32:32.972468 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-0e065f4e-c396-4a8c-afd1-dda7414ada9b tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:32:32.972900 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-0e065f4e-c396-4a8c-afd1-dda7414ada9b tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:32:32.979142 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-d3823aa9-e5b9-4fec-b772-f22a60d8a4dc tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb49b631c234f9a9fd47049b9b2e097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faead990837d43de8ec54bfaf24361de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:32:32.997138 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-d3823aa9-e5b9-4fec-b772-f22a60d8a4dc tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] 10.222.0.46 "GET /compute/v2.1/servers/81874e0c-3350-44a3-8108-be514b727575" status: 200 len: 1681 microversion: 2.1 time: 0.362654 Aug 04 05:32:32.997138 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 383/772] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:32:32 2022] GET /compute/v2.1/servers/81874e0c-3350-44a3-8108-be514b727575 => generated 1681 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 05:32:33.003636 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-0e065f4e-c396-4a8c-afd1-dda7414ada9b tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] 10.222.0.46 "GET /compute/v2.1/servers/938a0d12-9045-4220-b0ee-a4ed0a3c4b6a/os-volume_attachments/4e7f7fd4-192c-4efc-aa7a-1349ae52c3de" status: 200 len: 194 microversion: 2.1 time: 0.043406 Aug 04 05:32:33.007354 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 390/773] 10.222.0.46 () {58 vars in 1413 bytes} [Thu Aug 4 05:32:32 2022] GET /compute/v2.1/servers/938a0d12-9045-4220-b0ee-a4ed0a3c4b6a/os-volume_attachments/4e7f7fd4-192c-4efc-aa7a-1349ae52c3de => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:32:33.015343 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-eac3ab06-769c-45c2-b811-9b7d36713047 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:32:33.015861 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-eac3ab06-769c-45c2-b811-9b7d36713047 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] [instance: 938a0d12-9045-4220-b0ee-a4ed0a3c4b6a] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:32:33.022294 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-eac3ab06-769c-45c2-b811-9b7d36713047 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:32:33.022777 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-eac3ab06-769c-45c2-b811-9b7d36713047 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:32:33.023547 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-eac3ab06-769c-45c2-b811-9b7d36713047 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:32:33.023973 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-eac3ab06-769c-45c2-b811-9b7d36713047 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:32:33.110141 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.objects.instance [None req-eac3ab06-769c-45c2-b811-9b7d36713047 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lazy-loading 'services' on Instance uuid 938a0d12-9045-4220-b0ee-a4ed0a3c4b6a {{(pid=118476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 05:32:33.364855 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-eac3ab06-769c-45c2-b811-9b7d36713047 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] 10.222.0.46 "DELETE /compute/v2.1/servers/938a0d12-9045-4220-b0ee-a4ed0a3c4b6a/os-volume_attachments/4e7f7fd4-192c-4efc-aa7a-1349ae52c3de" status: 202 len: 0 microversion: 2.1 time: 0.353389 Aug 04 05:32:33.366621 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 384/774] 10.222.0.46 () {58 vars in 1416 bytes} [Thu Aug 4 05:32:33 2022] DELETE /compute/v2.1/servers/938a0d12-9045-4220-b0ee-a4ed0a3c4b6a/os-volume_attachments/4e7f7fd4-192c-4efc-aa7a-1349ae52c3de => generated 0 bytes in 356 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 05:32:33.501120 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [req-731d956b-bad1-4618-8258-7f99fff5c320 req-920322cc-dc5f-4e5d-abdf-09a3813d510c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "81874e0c-3350-44a3-8108-be514b727575", "name": "network-vif-deleted", "tag": "2bdd1a30-d52a-4486-a7b1-3ca17440e0a8"}]} {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:32:33.512168 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [req-731d956b-bad1-4618-8258-7f99fff5c320 req-920322cc-dc5f-4e5d-abdf-09a3813d510c service nova] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:32:33.520759 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [req-731d956b-bad1-4618-8258-7f99fff5c320 req-920322cc-dc5f-4e5d-abdf-09a3813d510c service nova] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:32:33.537487 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.compute.server_external_events [req-731d956b-bad1-4618-8258-7f99fff5c320 req-920322cc-dc5f-4e5d-abdf-09a3813d510c service nova] Creating event network-vif-deleted:2bdd1a30-d52a-4486-a7b1-3ca17440e0a8 for instance 81874e0c-3350-44a3-8108-be514b727575 on hv-cinder-85207 Aug 04 05:32:33.545908 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [req-731d956b-bad1-4618-8258-7f99fff5c320 req-920322cc-dc5f-4e5d-abdf-09a3813d510c service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053592 Aug 04 05:32:33.553333 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 391/775] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Aug 4 05:32:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:32:33.987550 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-4baadd2d-2a77-45ee-a49f-0a4c83bab62a tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:32:33.989307 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-4baadd2d-2a77-45ee-a49f-0a4c83bab62a tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] [instance: 2e3bce83-6dff-479d-a54c-8f660fbbcdc5] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:32:34.010609 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG dbcounter [-] [118476] Writing DB stats nova_api:SELECT=51 {{(pid=118476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:32:34.016280 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-4baadd2d-2a77-45ee-a49f-0a4c83bab62a tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:32:34.016726 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-4baadd2d-2a77-45ee-a49f-0a4c83bab62a tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:32:34.018644 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-4baadd2d-2a77-45ee-a49f-0a4c83bab62a tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:32:34.018828 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-32c2735f-c66e-4161-8aec-9050f5ca1dd5 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:32:34.019315 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-4baadd2d-2a77-45ee-a49f-0a4c83bab62a tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:32:34.020159 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-32c2735f-c66e-4161-8aec-9050f5ca1dd5 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] [instance: 81874e0c-3350-44a3-8108-be514b727575] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:32:34.026988 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-32c2735f-c66e-4161-8aec-9050f5ca1dd5 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:32:34.027666 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-32c2735f-c66e-4161-8aec-9050f5ca1dd5 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:32:34.028946 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-32c2735f-c66e-4161-8aec-9050f5ca1dd5 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:32:34.029532 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-32c2735f-c66e-4161-8aec-9050f5ca1dd5 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:32:34.112324 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-32c2735f-c66e-4161-8aec-9050f5ca1dd5 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:32:34.113388 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-32c2735f-c66e-4161-8aec-9050f5ca1dd5 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:32:34.114298 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.objects.instance [None req-32c2735f-c66e-4161-8aec-9050f5ca1dd5 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lazy-loading 'fault' on Instance uuid 81874e0c-3350-44a3-8108-be514b727575 {{(pid=118477) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 05:32:34.176188 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-32c2735f-c66e-4161-8aec-9050f5ca1dd5 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb49b631c234f9a9fd47049b9b2e097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faead990837d43de8ec54bfaf24361de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:32:34.197743 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-32c2735f-c66e-4161-8aec-9050f5ca1dd5 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] 10.222.0.46 "GET /compute/v2.1/servers/81874e0c-3350-44a3-8108-be514b727575" status: 200 len: 1330 microversion: 2.1 time: 0.184075 Aug 04 05:32:34.210732 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 392/776] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:32:34 2022] GET /compute/v2.1/servers/81874e0c-3350-44a3-8108-be514b727575 => generated 1330 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:32:34.271675 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-4baadd2d-2a77-45ee-a49f-0a4c83bab62a tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:32:34.281624 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-4baadd2d-2a77-45ee-a49f-0a4c83bab62a tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:32:34.283835 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-4baadd2d-2a77-45ee-a49f-0a4c83bab62a tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:32:34.285038 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-4baadd2d-2a77-45ee-a49f-0a4c83bab62a tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] 10.222.0.46 "GET /compute/v2.1/servers/2e3bce83-6dff-479d-a54c-8f660fbbcdc5" status: 200 len: 1740 microversion: 2.20 time: 0.303788 Aug 04 05:32:34.285801 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 385/777] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Aug 4 05:32:33 2022] GET /compute/v2.1/servers/2e3bce83-6dff-479d-a54c-8f660fbbcdc5 => generated 1740 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 05:32:35.225379 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-74f56afb-79e9-4e67-9689-179c133aef0b tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:32:35.226679 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-74f56afb-79e9-4e67-9689-179c133aef0b tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] [instance: 81874e0c-3350-44a3-8108-be514b727575] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:32:35.233906 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-74f56afb-79e9-4e67-9689-179c133aef0b tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:32:35.234364 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-74f56afb-79e9-4e67-9689-179c133aef0b tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:32:35.235200 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-74f56afb-79e9-4e67-9689-179c133aef0b tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:32:35.235631 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-74f56afb-79e9-4e67-9689-179c133aef0b tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:32:35.250383 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.wsgi [None req-74f56afb-79e9-4e67-9689-179c133aef0b tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] HTTP exception thrown: Instance 81874e0c-3350-44a3-8108-be514b727575 could not be found. Aug 04 05:32:35.252255 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-74f56afb-79e9-4e67-9689-179c133aef0b tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Request method failure captured: Aug 04 05:32:35.252255 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: request: GET /compute/v2.1/servers/81874e0c-3350-44a3-8108-be514b727575 HTTP/1.1 Aug 04 05:32:35.252255 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: Accept: application/json Aug 04 05:32:35.252255 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: Accept-Encoding: identity Aug 04 05:32:35.252255 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: Connection: close Aug 04 05:32:35.252255 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: Content-Length: 0 Aug 04 05:32:35.252255 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: Content-Type: application/json Aug 04 05:32:35.252255 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: Host: 10.222.0.46 Aug 04 05:32:35.252255 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: Openstack-System-Scope: None Aug 04 05:32:35.252255 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: User-Agent: python-urllib3/1.26.11 Aug 04 05:32:35.252255 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Auth-Token: gAAAAABi61g0x_8sFigG1jfXTOdqOMY1_3lK7UxaN3VmL5lqQXtIkCz4pWJYdYey2zGuiTigaV5gr0UWhaKZvxst4Kz-KOaAO64aM30ubWqVQfLIrJqf-RP6LF-c0ZabM-LUcJmxEmCuhHsUTEzNbVJn1WT0ja1hpuQC9pVY6l0Uzp1TYNzYyh0 Aug 04 05:32:35.252255 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Domain-Id: None Aug 04 05:32:35.252255 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Domain-Name: None Aug 04 05:32:35.252255 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Identity-Status: Confirmed Aug 04 05:32:35.252255 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Is-Admin-Project: True Aug 04 05:32:35.252255 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Project-Domain-Id: default Aug 04 05:32:35.252255 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Project-Domain-Name: Default Aug 04 05:32:35.252255 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Project-Id: faead990837d43de8ec54bfaf24361de Aug 04 05:32:35.252255 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Project-Name: tempest-AttachVolumeNegativeTest-710656709 Aug 04 05:32:35.252255 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Role: member,reader Aug 04 05:32:35.252255 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Roles: member,reader Aug 04 05:32:35.253842 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/faead990837d43de8ec54bfaf24361de"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/faead990837d43de8ec54bfaf24361de"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_faead990837d43de8ec54bfaf24361de", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/faead990837d43de8ec54bfaf24361de"}]}] Aug 04 05:32:35.253842 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Tenant: tempest-AttachVolumeNegativeTest-710656709 Aug 04 05:32:35.253842 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Tenant-Id: faead990837d43de8ec54bfaf24361de Aug 04 05:32:35.253842 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-710656709 Aug 04 05:32:35.253842 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-User: tempest-AttachVolumeNegativeTest-710656709-project Aug 04 05:32:35.253842 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-User-Domain-Id: default Aug 04 05:32:35.253842 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-User-Domain-Name: Default Aug 04 05:32:35.253842 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-User-Id: 9cb49b631c234f9a9fd47049b9b2e097 Aug 04 05:32:35.253842 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-User-Name: tempest-AttachVolumeNegativeTest-710656709-project Aug 04 05:32:35.253842 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: method: > Aug 04 05:32:35.253842 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: exception: Instance 81874e0c-3350-44a3-8108-be514b727575 could not be found. Aug 04 05:32:35.253842 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: action_args: {'id': '81874e0c-3350-44a3-8108-be514b727575'} Aug 04 05:32:35.254802 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 05:32:35.254802 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:32:35.254802 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 05:32:35.254802 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 05:32:35.254802 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 05:32:35.254802 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 05:32:35.254802 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 05:32:35.254802 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 05:32:35.254802 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 05:32:35.254802 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 05:32:35.254802 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 81874e0c-3350-44a3-8108-be514b727575 could not be found. Aug 04 05:32:35.254802 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Aug 04 05:32:35.254802 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:32:35.254802 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Aug 04 05:32:35.254802 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:32:35.254802 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:32:35.254802 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:32:35.254802 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 05:32:35.254802 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 05:32:35.254802 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 05:32:35.256292 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 05:32:35.256292 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 05:32:35.256292 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 05:32:35.256292 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 05:32:35.256292 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 05:32:35.256292 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 05:32:35.256292 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 05:32:35.256292 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 81874e0c-3350-44a3-8108-be514b727575 could not be found. Aug 04 05:32:35.256292 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Aug 04 05:32:35.256292 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:32:35.256292 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Aug 04 05:32:35.256292 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:32:35.256292 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:32:35.256292 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:32:35.256292 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 05:32:35.256292 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 05:32:35.256292 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 81874e0c-3350-44a3-8108-be514b727575 could not be found. Aug 04 05:32:35.256292 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Aug 04 05:32:35.257626 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-74f56afb-79e9-4e67-9689-179c133aef0b tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Returning 404 to user: Instance 81874e0c-3350-44a3-8108-be514b727575 could not be found. {{(pid=118477) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 05:32:35.257626 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-74f56afb-79e9-4e67-9689-179c133aef0b tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] 10.222.0.46 "GET /compute/v2.1/servers/81874e0c-3350-44a3-8108-be514b727575" status: 404 len: 111 microversion: 2.1 time: 0.034649 Aug 04 05:32:35.258108 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 393/778] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:32:35 2022] GET /compute/v2.1/servers/81874e0c-3350-44a3-8108-be514b727575 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 05:32:35.266516 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-cfed7b58-757c-4134-85c6-6c5313b15168 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Calling method '.version_select at 0x7f1475408d30>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:32:35.309860 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-b8acc2d3-8877-4717-bc09-f8e7bba15f46 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:32:35.310945 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-b8acc2d3-8877-4717-bc09-f8e7bba15f46 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] [instance: 2e3bce83-6dff-479d-a54c-8f660fbbcdc5] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:32:35.317791 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-b8acc2d3-8877-4717-bc09-f8e7bba15f46 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:32:35.318466 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-b8acc2d3-8877-4717-bc09-f8e7bba15f46 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:32:35.319555 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-b8acc2d3-8877-4717-bc09-f8e7bba15f46 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:32:35.320171 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-b8acc2d3-8877-4717-bc09-f8e7bba15f46 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:32:35.361307 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-cfed7b58-757c-4134-85c6-6c5313b15168 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-557213845" status: 202 len: 0 microversion: 2.1 time: 0.098607 Aug 04 05:32:35.362592 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 386/779] 10.222.0.46 () {58 vars in 1218 bytes} [Thu Aug 4 05:32:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-557213845 => generated 0 bytes in 100 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 05:32:35.530446 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-b8acc2d3-8877-4717-bc09-f8e7bba15f46 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:32:35.543264 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-b8acc2d3-8877-4717-bc09-f8e7bba15f46 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:32:35.544888 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-b8acc2d3-8877-4717-bc09-f8e7bba15f46 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:32:35.546110 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-b8acc2d3-8877-4717-bc09-f8e7bba15f46 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] 10.222.0.46 "GET /compute/v2.1/servers/2e3bce83-6dff-479d-a54c-8f660fbbcdc5" status: 200 len: 1740 microversion: 2.20 time: 0.241079 Aug 04 05:32:35.546723 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 394/780] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Aug 4 05:32:35 2022] GET /compute/v2.1/servers/2e3bce83-6dff-479d-a54c-8f660fbbcdc5 => generated 1740 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 05:32:35.691597 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-36424cd6-3ba4-48df-b8d6-403a44a66fa1 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:32:35.694086 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-36424cd6-3ba4-48df-b8d6-403a44a66fa1 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] [instance: 938a0d12-9045-4220-b0ee-a4ed0a3c4b6a] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:32:35.702956 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-36424cd6-3ba4-48df-b8d6-403a44a66fa1 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:32:35.703307 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-36424cd6-3ba4-48df-b8d6-403a44a66fa1 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:32:35.704092 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-36424cd6-3ba4-48df-b8d6-403a44a66fa1 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:32:35.705220 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-36424cd6-3ba4-48df-b8d6-403a44a66fa1 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:32:35.786278 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-36424cd6-3ba4-48df-b8d6-403a44a66fa1 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] 10.222.0.46 "GET /compute/v2.1/servers/938a0d12-9045-4220-b0ee-a4ed0a3c4b6a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.099700 Aug 04 05:32:35.816157 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 387/781] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Aug 4 05:32:35 2022] GET /compute/v2.1/servers/938a0d12-9045-4220-b0ee-a4ed0a3c4b6a/os-volume_attachments => generated 25 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 05:32:35.943876 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-be83a8a7-3a25-41fb-acc2-54ddf8d05dac tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:32:35.946021 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-be83a8a7-3a25-41fb-acc2-54ddf8d05dac tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] [instance: 938a0d12-9045-4220-b0ee-a4ed0a3c4b6a] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:32:35.951981 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG dbcounter [-] [118477] Writing DB stats nova_api:SELECT=62,nova_api:UPDATE=1 {{(pid=118477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:32:35.953631 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-be83a8a7-3a25-41fb-acc2-54ddf8d05dac tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:32:35.954024 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-be83a8a7-3a25-41fb-acc2-54ddf8d05dac tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:32:35.955609 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-be83a8a7-3a25-41fb-acc2-54ddf8d05dac tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:32:35.956115 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-be83a8a7-3a25-41fb-acc2-54ddf8d05dac tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:32:35.978511 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG dbcounter [-] [118477] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=118477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:32:35.991292 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-be83a8a7-3a25-41fb-acc2-54ddf8d05dac tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] 10.222.0.46 "GET /compute/v2.1/servers/938a0d12-9045-4220-b0ee-a4ed0a3c4b6a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.051340 Aug 04 05:32:35.992504 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 395/782] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Aug 4 05:32:35 2022] GET /compute/v2.1/servers/938a0d12-9045-4220-b0ee-a4ed0a3c4b6a/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 05:32:36.090473 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-821d1df2-5f0f-41e2-8356-785ee78f6c87 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:32:36.092164 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-821d1df2-5f0f-41e2-8356-785ee78f6c87 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] [instance: 938a0d12-9045-4220-b0ee-a4ed0a3c4b6a] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:32:36.111759 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-821d1df2-5f0f-41e2-8356-785ee78f6c87 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:32:36.113026 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-821d1df2-5f0f-41e2-8356-785ee78f6c87 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:32:36.114662 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-821d1df2-5f0f-41e2-8356-785ee78f6c87 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:32:36.117433 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-821d1df2-5f0f-41e2-8356-785ee78f6c87 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:32:36.168431 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-821d1df2-5f0f-41e2-8356-785ee78f6c87 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] [instance: 938a0d12-9045-4220-b0ee-a4ed0a3c4b6a] Going to try to terminate instance {{(pid=118476) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 05:32:36.584220 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-b3545f6f-7fb1-458a-9334-07ba7dda7b54 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:32:36.584814 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-b3545f6f-7fb1-458a-9334-07ba7dda7b54 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] [instance: 2e3bce83-6dff-479d-a54c-8f660fbbcdc5] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:32:36.593007 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-b3545f6f-7fb1-458a-9334-07ba7dda7b54 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:32:36.593455 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-b3545f6f-7fb1-458a-9334-07ba7dda7b54 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:32:36.594215 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-b3545f6f-7fb1-458a-9334-07ba7dda7b54 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:32:36.594669 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-b3545f6f-7fb1-458a-9334-07ba7dda7b54 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:32:36.745209 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-b3545f6f-7fb1-458a-9334-07ba7dda7b54 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:32:36.752302 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-b3545f6f-7fb1-458a-9334-07ba7dda7b54 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:32:36.753836 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-b3545f6f-7fb1-458a-9334-07ba7dda7b54 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:32:36.755028 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-b3545f6f-7fb1-458a-9334-07ba7dda7b54 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] 10.222.0.46 "GET /compute/v2.1/servers/2e3bce83-6dff-479d-a54c-8f660fbbcdc5" status: 200 len: 1740 microversion: 2.20 time: 0.175755 Aug 04 05:32:36.755592 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 396/783] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Aug 4 05:32:36 2022] GET /compute/v2.1/servers/2e3bce83-6dff-479d-a54c-8f660fbbcdc5 => generated 1740 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 05:32:36.809084 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-821d1df2-5f0f-41e2-8356-785ee78f6c87 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] 10.222.0.46 "DELETE /compute/v2.1/servers/938a0d12-9045-4220-b0ee-a4ed0a3c4b6a" status: 204 len: 0 microversion: 2.1 time: 0.723075 Aug 04 05:32:36.809695 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 388/784] 10.222.0.46 () {58 vars in 1239 bytes} [Thu Aug 4 05:32:36 2022] DELETE /compute/v2.1/servers/938a0d12-9045-4220-b0ee-a4ed0a3c4b6a => generated 0 bytes in 725 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 05:32:36.818509 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-a272f428-b7d0-42f3-8212-ca443d086c37 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:32:36.819116 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-a272f428-b7d0-42f3-8212-ca443d086c37 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] [instance: 938a0d12-9045-4220-b0ee-a4ed0a3c4b6a] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:32:36.825240 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-a272f428-b7d0-42f3-8212-ca443d086c37 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:32:36.826847 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-a272f428-b7d0-42f3-8212-ca443d086c37 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:32:36.826847 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-a272f428-b7d0-42f3-8212-ca443d086c37 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:32:36.827078 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-a272f428-b7d0-42f3-8212-ca443d086c37 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:32:36.969902 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-a272f428-b7d0-42f3-8212-ca443d086c37 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb4dea95659c473b9b193c6234186430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1ca4b83dc874bda9f33e06f4910608c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:32:36.979469 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-a272f428-b7d0-42f3-8212-ca443d086c37 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] 10.222.0.46 "GET /compute/v2.1/servers/938a0d12-9045-4220-b0ee-a4ed0a3c4b6a" status: 200 len: 1672 microversion: 2.1 time: 0.163894 Aug 04 05:32:36.979469 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 397/785] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:32:36 2022] GET /compute/v2.1/servers/938a0d12-9045-4220-b0ee-a4ed0a3c4b6a => generated 1672 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:32:37.782212 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-8a56d9d9-19e9-454d-9e0e-005cfa696c1b tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:32:37.783731 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-8a56d9d9-19e9-454d-9e0e-005cfa696c1b tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] [instance: 2e3bce83-6dff-479d-a54c-8f660fbbcdc5] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:32:37.796219 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-8a56d9d9-19e9-454d-9e0e-005cfa696c1b tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:32:37.796672 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-8a56d9d9-19e9-454d-9e0e-005cfa696c1b tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:32:37.797454 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-8a56d9d9-19e9-454d-9e0e-005cfa696c1b tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:32:37.797888 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-8a56d9d9-19e9-454d-9e0e-005cfa696c1b tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:32:38.000543 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-8d4d70c1-1da5-48c5-91e1-25fa306cf1cb tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:32:38.002406 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-8d4d70c1-1da5-48c5-91e1-25fa306cf1cb tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] [instance: 938a0d12-9045-4220-b0ee-a4ed0a3c4b6a] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:32:38.010050 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-8d4d70c1-1da5-48c5-91e1-25fa306cf1cb tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:32:38.010753 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-8d4d70c1-1da5-48c5-91e1-25fa306cf1cb tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:32:38.011930 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-8d4d70c1-1da5-48c5-91e1-25fa306cf1cb tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:32:38.012580 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-8d4d70c1-1da5-48c5-91e1-25fa306cf1cb tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:32:38.031193 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-8a56d9d9-19e9-454d-9e0e-005cfa696c1b tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:32:38.040782 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-8a56d9d9-19e9-454d-9e0e-005cfa696c1b tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:32:38.042681 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-8a56d9d9-19e9-454d-9e0e-005cfa696c1b tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:32:38.060496 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-8a56d9d9-19e9-454d-9e0e-005cfa696c1b tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] 10.222.0.46 "GET /compute/v2.1/servers/2e3bce83-6dff-479d-a54c-8f660fbbcdc5" status: 200 len: 1740 microversion: 2.20 time: 0.282794 Aug 04 05:32:38.062955 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 389/786] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Aug 4 05:32:37 2022] GET /compute/v2.1/servers/2e3bce83-6dff-479d-a54c-8f660fbbcdc5 => generated 1740 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 05:32:38.117228 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-acaf2b26-b2ed-4559-935b-e742b99d7c6d tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:32:38.117729 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-acaf2b26-b2ed-4559-935b-e742b99d7c6d tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] [instance: 81874e0c-3350-44a3-8108-be514b727575] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:32:38.124010 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-acaf2b26-b2ed-4559-935b-e742b99d7c6d tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:32:38.124665 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-acaf2b26-b2ed-4559-935b-e742b99d7c6d tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:32:38.125635 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-acaf2b26-b2ed-4559-935b-e742b99d7c6d tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:32:38.126062 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-acaf2b26-b2ed-4559-935b-e742b99d7c6d tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:32:38.141082 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.wsgi [None req-acaf2b26-b2ed-4559-935b-e742b99d7c6d tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] HTTP exception thrown: Instance 81874e0c-3350-44a3-8108-be514b727575 could not be found. Aug 04 05:32:38.143322 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-acaf2b26-b2ed-4559-935b-e742b99d7c6d tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Request method failure captured: Aug 04 05:32:38.143322 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: request: DELETE /compute/v2.1/servers/81874e0c-3350-44a3-8108-be514b727575 HTTP/1.1 Aug 04 05:32:38.143322 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: Accept: application/json Aug 04 05:32:38.143322 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: Accept-Encoding: identity Aug 04 05:32:38.143322 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: Connection: close Aug 04 05:32:38.143322 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: Content-Length: 0 Aug 04 05:32:38.143322 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: Content-Type: application/json Aug 04 05:32:38.143322 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: Host: 10.222.0.46 Aug 04 05:32:38.143322 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: Openstack-System-Scope: None Aug 04 05:32:38.143322 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: User-Agent: python-urllib3/1.26.11 Aug 04 05:32:38.143322 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Auth-Token: gAAAAABi61g0x_8sFigG1jfXTOdqOMY1_3lK7UxaN3VmL5lqQXtIkCz4pWJYdYey2zGuiTigaV5gr0UWhaKZvxst4Kz-KOaAO64aM30ubWqVQfLIrJqf-RP6LF-c0ZabM-LUcJmxEmCuhHsUTEzNbVJn1WT0ja1hpuQC9pVY6l0Uzp1TYNzYyh0 Aug 04 05:32:38.143322 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Domain-Id: None Aug 04 05:32:38.143322 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Domain-Name: None Aug 04 05:32:38.143322 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Identity-Status: Confirmed Aug 04 05:32:38.143322 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Is-Admin-Project: True Aug 04 05:32:38.143322 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Project-Domain-Id: default Aug 04 05:32:38.143322 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Project-Domain-Name: Default Aug 04 05:32:38.143322 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Project-Id: faead990837d43de8ec54bfaf24361de Aug 04 05:32:38.143322 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Project-Name: tempest-AttachVolumeNegativeTest-710656709 Aug 04 05:32:38.143322 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Role: member,reader Aug 04 05:32:38.143322 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Roles: member,reader Aug 04 05:32:38.144867 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/faead990837d43de8ec54bfaf24361de"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/faead990837d43de8ec54bfaf24361de"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_faead990837d43de8ec54bfaf24361de", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/faead990837d43de8ec54bfaf24361de"}]}] Aug 04 05:32:38.144867 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Tenant: tempest-AttachVolumeNegativeTest-710656709 Aug 04 05:32:38.144867 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Tenant-Id: faead990837d43de8ec54bfaf24361de Aug 04 05:32:38.144867 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-710656709 Aug 04 05:32:38.144867 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-User: tempest-AttachVolumeNegativeTest-710656709-project Aug 04 05:32:38.144867 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-User-Domain-Id: default Aug 04 05:32:38.144867 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-User-Domain-Name: Default Aug 04 05:32:38.144867 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-User-Id: 9cb49b631c234f9a9fd47049b9b2e097 Aug 04 05:32:38.144867 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-User-Name: tempest-AttachVolumeNegativeTest-710656709-project Aug 04 05:32:38.144867 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: method: > Aug 04 05:32:38.144867 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: exception: Instance 81874e0c-3350-44a3-8108-be514b727575 could not be found. Aug 04 05:32:38.144867 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: action_args: {'id': '81874e0c-3350-44a3-8108-be514b727575'} Aug 04 05:32:38.145743 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 05:32:38.145743 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:32:38.145743 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 05:32:38.145743 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 05:32:38.145743 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 05:32:38.145743 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 05:32:38.145743 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 05:32:38.145743 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 05:32:38.145743 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 05:32:38.145743 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 05:32:38.145743 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 81874e0c-3350-44a3-8108-be514b727575 could not be found. Aug 04 05:32:38.145743 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Aug 04 05:32:38.145743 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:32:38.145743 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Aug 04 05:32:38.145743 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:32:38.145743 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:32:38.145743 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:32:38.145743 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 05:32:38.145743 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 05:32:38.145743 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 05:32:38.147106 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 05:32:38.147106 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 05:32:38.147106 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 05:32:38.147106 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 05:32:38.147106 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 05:32:38.147106 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 05:32:38.147106 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 05:32:38.147106 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 05:32:38.147106 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 05:32:38.147106 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 81874e0c-3350-44a3-8108-be514b727575 could not be found. Aug 04 05:32:38.147106 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Aug 04 05:32:38.147106 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:32:38.147106 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Aug 04 05:32:38.147106 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:32:38.147106 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:32:38.147106 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:32:38.147106 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 05:32:38.147106 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 05:32:38.147106 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 81874e0c-3350-44a3-8108-be514b727575 could not be found. Aug 04 05:32:38.147106 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Aug 04 05:32:38.149175 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-acaf2b26-b2ed-4559-935b-e742b99d7c6d tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Returning 404 to user: Instance 81874e0c-3350-44a3-8108-be514b727575 could not be found. {{(pid=118476) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 05:32:38.150347 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-acaf2b26-b2ed-4559-935b-e742b99d7c6d tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] 10.222.0.46 "DELETE /compute/v2.1/servers/81874e0c-3350-44a3-8108-be514b727575" status: 404 len: 111 microversion: 2.1 time: 0.036971 Aug 04 05:32:38.151385 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 390/787] 10.222.0.46 () {58 vars in 1239 bytes} [Thu Aug 4 05:32:38 2022] DELETE /compute/v2.1/servers/81874e0c-3350-44a3-8108-be514b727575 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 04 05:32:38.162966 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-e8cf39f0-dd3f-48ee-93ed-e28ff62e941b tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:32:38.163858 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-e8cf39f0-dd3f-48ee-93ed-e28ff62e941b tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] [instance: 81874e0c-3350-44a3-8108-be514b727575] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:32:38.175196 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-e8cf39f0-dd3f-48ee-93ed-e28ff62e941b tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:32:38.175898 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-e8cf39f0-dd3f-48ee-93ed-e28ff62e941b tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:32:38.178172 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-e8cf39f0-dd3f-48ee-93ed-e28ff62e941b tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:32:38.178758 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-e8cf39f0-dd3f-48ee-93ed-e28ff62e941b tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:32:38.198914 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.wsgi [None req-e8cf39f0-dd3f-48ee-93ed-e28ff62e941b tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] HTTP exception thrown: Instance 81874e0c-3350-44a3-8108-be514b727575 could not be found. Aug 04 05:32:38.201064 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-e8cf39f0-dd3f-48ee-93ed-e28ff62e941b tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Request method failure captured: Aug 04 05:32:38.201064 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: request: GET /compute/v2.1/servers/81874e0c-3350-44a3-8108-be514b727575 HTTP/1.1 Aug 04 05:32:38.201064 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: Accept: application/json Aug 04 05:32:38.201064 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: Accept-Encoding: identity Aug 04 05:32:38.201064 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: Connection: close Aug 04 05:32:38.201064 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: Content-Length: 0 Aug 04 05:32:38.201064 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: Content-Type: application/json Aug 04 05:32:38.201064 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: Host: 10.222.0.46 Aug 04 05:32:38.201064 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: Openstack-System-Scope: None Aug 04 05:32:38.201064 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: User-Agent: python-urllib3/1.26.11 Aug 04 05:32:38.201064 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Auth-Token: gAAAAABi61g0x_8sFigG1jfXTOdqOMY1_3lK7UxaN3VmL5lqQXtIkCz4pWJYdYey2zGuiTigaV5gr0UWhaKZvxst4Kz-KOaAO64aM30ubWqVQfLIrJqf-RP6LF-c0ZabM-LUcJmxEmCuhHsUTEzNbVJn1WT0ja1hpuQC9pVY6l0Uzp1TYNzYyh0 Aug 04 05:32:38.201064 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Domain-Id: None Aug 04 05:32:38.201064 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Domain-Name: None Aug 04 05:32:38.201064 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Identity-Status: Confirmed Aug 04 05:32:38.201064 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Is-Admin-Project: True Aug 04 05:32:38.201064 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Project-Domain-Id: default Aug 04 05:32:38.201064 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Project-Domain-Name: Default Aug 04 05:32:38.201064 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Project-Id: faead990837d43de8ec54bfaf24361de Aug 04 05:32:38.201064 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Project-Name: tempest-AttachVolumeNegativeTest-710656709 Aug 04 05:32:38.201064 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Role: member,reader Aug 04 05:32:38.201064 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Roles: member,reader Aug 04 05:32:38.202532 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/faead990837d43de8ec54bfaf24361de"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/faead990837d43de8ec54bfaf24361de"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_faead990837d43de8ec54bfaf24361de", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/faead990837d43de8ec54bfaf24361de"}]}] Aug 04 05:32:38.202532 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Tenant: tempest-AttachVolumeNegativeTest-710656709 Aug 04 05:32:38.202532 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Tenant-Id: faead990837d43de8ec54bfaf24361de Aug 04 05:32:38.202532 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-710656709 Aug 04 05:32:38.202532 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-User: tempest-AttachVolumeNegativeTest-710656709-project Aug 04 05:32:38.202532 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-User-Domain-Id: default Aug 04 05:32:38.202532 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-User-Domain-Name: Default Aug 04 05:32:38.202532 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-User-Id: 9cb49b631c234f9a9fd47049b9b2e097 Aug 04 05:32:38.202532 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-User-Name: tempest-AttachVolumeNegativeTest-710656709-project Aug 04 05:32:38.202532 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: method: > Aug 04 05:32:38.202532 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: exception: Instance 81874e0c-3350-44a3-8108-be514b727575 could not be found. Aug 04 05:32:38.202532 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: action_args: {'id': '81874e0c-3350-44a3-8108-be514b727575'} Aug 04 05:32:38.203314 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 05:32:38.203314 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:32:38.203314 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 05:32:38.203314 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 05:32:38.203314 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 05:32:38.203314 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 05:32:38.203314 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 05:32:38.203314 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 05:32:38.203314 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 05:32:38.203314 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 05:32:38.203314 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 81874e0c-3350-44a3-8108-be514b727575 could not be found. Aug 04 05:32:38.203314 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Aug 04 05:32:38.203314 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:32:38.203314 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Aug 04 05:32:38.203314 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:32:38.203314 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:32:38.203314 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:32:38.203314 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 05:32:38.203314 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 05:32:38.203314 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 05:32:38.205871 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 05:32:38.205871 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 05:32:38.205871 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 05:32:38.205871 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 05:32:38.205871 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 05:32:38.205871 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 05:32:38.205871 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 05:32:38.205871 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 81874e0c-3350-44a3-8108-be514b727575 could not be found. Aug 04 05:32:38.205871 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Aug 04 05:32:38.205871 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:32:38.205871 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Aug 04 05:32:38.205871 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:32:38.205871 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:32:38.205871 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:32:38.205871 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 05:32:38.205871 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 05:32:38.205871 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 81874e0c-3350-44a3-8108-be514b727575 could not be found. Aug 04 05:32:38.205871 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Aug 04 05:32:38.208380 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-e8cf39f0-dd3f-48ee-93ed-e28ff62e941b tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Returning 404 to user: Instance 81874e0c-3350-44a3-8108-be514b727575 could not be found. {{(pid=118476) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 05:32:38.208380 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-e8cf39f0-dd3f-48ee-93ed-e28ff62e941b tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] 10.222.0.46 "GET /compute/v2.1/servers/81874e0c-3350-44a3-8108-be514b727575" status: 404 len: 111 microversion: 2.1 time: 0.050772 Aug 04 05:32:38.210821 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 391/788] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:32:38 2022] GET /compute/v2.1/servers/81874e0c-3350-44a3-8108-be514b727575 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 05:32:38.326657 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-8d4d70c1-1da5-48c5-91e1-25fa306cf1cb tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb4dea95659c473b9b193c6234186430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1ca4b83dc874bda9f33e06f4910608c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:32:38.335383 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-8d4d70c1-1da5-48c5-91e1-25fa306cf1cb tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] 10.222.0.46 "GET /compute/v2.1/servers/938a0d12-9045-4220-b0ee-a4ed0a3c4b6a" status: 200 len: 1672 microversion: 2.1 time: 0.339183 Aug 04 05:32:38.336583 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 398/789] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:32:37 2022] GET /compute/v2.1/servers/938a0d12-9045-4220-b0ee-a4ed0a3c4b6a => generated 1672 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:32:39.086140 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-92952999-9cd4-48bc-9900-f1cd70331f4e tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:32:39.090264 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-92952999-9cd4-48bc-9900-f1cd70331f4e tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] [instance: 2e3bce83-6dff-479d-a54c-8f660fbbcdc5] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:32:39.097738 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-92952999-9cd4-48bc-9900-f1cd70331f4e tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:32:39.098290 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-92952999-9cd4-48bc-9900-f1cd70331f4e tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:32:39.099467 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-92952999-9cd4-48bc-9900-f1cd70331f4e tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:32:39.099916 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-92952999-9cd4-48bc-9900-f1cd70331f4e tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:32:39.358324 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-953f1a84-81d3-4cd5-94c7-37935bd407e2 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:32:39.358940 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-953f1a84-81d3-4cd5-94c7-37935bd407e2 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] [instance: 938a0d12-9045-4220-b0ee-a4ed0a3c4b6a] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:32:39.366073 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-953f1a84-81d3-4cd5-94c7-37935bd407e2 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:32:39.366558 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-953f1a84-81d3-4cd5-94c7-37935bd407e2 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:32:39.367332 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-953f1a84-81d3-4cd5-94c7-37935bd407e2 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:32:39.367768 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-953f1a84-81d3-4cd5-94c7-37935bd407e2 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:32:39.777161 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-92952999-9cd4-48bc-9900-f1cd70331f4e tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:32:39.781106 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG dbcounter [-] [118476] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=118476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:32:39.787106 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-92952999-9cd4-48bc-9900-f1cd70331f4e tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:32:39.788707 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-92952999-9cd4-48bc-9900-f1cd70331f4e tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:32:39.789969 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-92952999-9cd4-48bc-9900-f1cd70331f4e tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] 10.222.0.46 "GET /compute/v2.1/servers/2e3bce83-6dff-479d-a54c-8f660fbbcdc5" status: 200 len: 1740 microversion: 2.20 time: 0.707747 Aug 04 05:32:39.790660 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 392/790] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Aug 4 05:32:39 2022] GET /compute/v2.1/servers/2e3bce83-6dff-479d-a54c-8f660fbbcdc5 => generated 1740 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 05:32:39.809529 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-dda8aac2-6c88-40e5-a8f2-bec609ae2166 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:32:39.830938 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-dda8aac2-6c88-40e5-a8f2-bec609ae2166 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] [instance: b45583dc-f18b-4b4a-98e3-ef1bdcf41f80] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:32:39.830938 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-dda8aac2-6c88-40e5-a8f2-bec609ae2166 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:32:39.830938 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-dda8aac2-6c88-40e5-a8f2-bec609ae2166 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:32:39.830938 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-dda8aac2-6c88-40e5-a8f2-bec609ae2166 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:32:39.831326 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-dda8aac2-6c88-40e5-a8f2-bec609ae2166 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:32:39.832547 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.wsgi [None req-dda8aac2-6c88-40e5-a8f2-bec609ae2166 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] HTTP exception thrown: Instance b45583dc-f18b-4b4a-98e3-ef1bdcf41f80 could not be found. Aug 04 05:32:39.834081 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-dda8aac2-6c88-40e5-a8f2-bec609ae2166 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Request method failure captured: Aug 04 05:32:39.834081 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: request: DELETE /compute/v2.1/servers/b45583dc-f18b-4b4a-98e3-ef1bdcf41f80 HTTP/1.1 Aug 04 05:32:39.834081 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: Accept: application/json Aug 04 05:32:39.834081 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: Accept-Encoding: identity Aug 04 05:32:39.834081 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: Connection: close Aug 04 05:32:39.834081 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: Content-Length: 0 Aug 04 05:32:39.834081 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: Content-Type: application/json Aug 04 05:32:39.834081 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: Host: 10.222.0.46 Aug 04 05:32:39.834081 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: Openstack-System-Scope: None Aug 04 05:32:39.834081 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: User-Agent: python-urllib3/1.26.11 Aug 04 05:32:39.834081 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Auth-Token: gAAAAABi61g0x_8sFigG1jfXTOdqOMY1_3lK7UxaN3VmL5lqQXtIkCz4pWJYdYey2zGuiTigaV5gr0UWhaKZvxst4Kz-KOaAO64aM30ubWqVQfLIrJqf-RP6LF-c0ZabM-LUcJmxEmCuhHsUTEzNbVJn1WT0ja1hpuQC9pVY6l0Uzp1TYNzYyh0 Aug 04 05:32:39.834081 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Domain-Id: None Aug 04 05:32:39.834081 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Domain-Name: None Aug 04 05:32:39.834081 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Identity-Status: Confirmed Aug 04 05:32:39.834081 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Is-Admin-Project: True Aug 04 05:32:39.834081 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Project-Domain-Id: default Aug 04 05:32:39.834081 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Project-Domain-Name: Default Aug 04 05:32:39.834081 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Project-Id: faead990837d43de8ec54bfaf24361de Aug 04 05:32:39.834081 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Project-Name: tempest-AttachVolumeNegativeTest-710656709 Aug 04 05:32:39.834081 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Role: member,reader Aug 04 05:32:39.834081 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Roles: member,reader Aug 04 05:32:39.835561 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/faead990837d43de8ec54bfaf24361de"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/faead990837d43de8ec54bfaf24361de"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_faead990837d43de8ec54bfaf24361de", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/faead990837d43de8ec54bfaf24361de"}]}] Aug 04 05:32:39.835561 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Tenant: tempest-AttachVolumeNegativeTest-710656709 Aug 04 05:32:39.835561 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Tenant-Id: faead990837d43de8ec54bfaf24361de Aug 04 05:32:39.835561 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-710656709 Aug 04 05:32:39.835561 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-User: tempest-AttachVolumeNegativeTest-710656709-project Aug 04 05:32:39.835561 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-User-Domain-Id: default Aug 04 05:32:39.835561 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-User-Domain-Name: Default Aug 04 05:32:39.835561 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-User-Id: 9cb49b631c234f9a9fd47049b9b2e097 Aug 04 05:32:39.835561 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-User-Name: tempest-AttachVolumeNegativeTest-710656709-project Aug 04 05:32:39.835561 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: method: > Aug 04 05:32:39.835561 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: exception: Instance b45583dc-f18b-4b4a-98e3-ef1bdcf41f80 could not be found. Aug 04 05:32:39.835561 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: action_args: {'id': 'b45583dc-f18b-4b4a-98e3-ef1bdcf41f80'} Aug 04 05:32:39.836274 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 05:32:39.836274 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:32:39.836274 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 05:32:39.836274 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 05:32:39.836274 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 05:32:39.836274 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 05:32:39.836274 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 05:32:39.836274 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 05:32:39.836274 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 05:32:39.836274 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 05:32:39.836274 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b45583dc-f18b-4b4a-98e3-ef1bdcf41f80 could not be found. Aug 04 05:32:39.836274 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Aug 04 05:32:39.836274 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:32:39.836274 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Aug 04 05:32:39.836274 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:32:39.836274 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:32:39.836274 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:32:39.836274 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 05:32:39.836274 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 05:32:39.836274 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 05:32:39.837449 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 05:32:39.837449 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 05:32:39.837449 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 05:32:39.837449 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 05:32:39.837449 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 05:32:39.837449 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 05:32:39.837449 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 05:32:39.837449 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 05:32:39.837449 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 05:32:39.837449 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b45583dc-f18b-4b4a-98e3-ef1bdcf41f80 could not be found. Aug 04 05:32:39.837449 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Aug 04 05:32:39.837449 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:32:39.837449 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Aug 04 05:32:39.837449 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:32:39.837449 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:32:39.837449 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:32:39.837449 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 05:32:39.837449 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 05:32:39.837449 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b45583dc-f18b-4b4a-98e3-ef1bdcf41f80 could not be found. Aug 04 05:32:39.837449 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Aug 04 05:32:39.838791 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-dda8aac2-6c88-40e5-a8f2-bec609ae2166 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Returning 404 to user: Instance b45583dc-f18b-4b4a-98e3-ef1bdcf41f80 could not be found. {{(pid=118476) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 05:32:39.838791 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-dda8aac2-6c88-40e5-a8f2-bec609ae2166 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] 10.222.0.46 "DELETE /compute/v2.1/servers/b45583dc-f18b-4b4a-98e3-ef1bdcf41f80" status: 404 len: 111 microversion: 2.1 time: 0.032020 Aug 04 05:32:39.838791 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 393/791] 10.222.0.46 () {58 vars in 1239 bytes} [Thu Aug 4 05:32:39 2022] DELETE /compute/v2.1/servers/b45583dc-f18b-4b4a-98e3-ef1bdcf41f80 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 05:32:39.843915 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-309f38bb-3337-4944-9f26-f3fb0b026cc9 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:32:39.844737 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-309f38bb-3337-4944-9f26-f3fb0b026cc9 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] [instance: b45583dc-f18b-4b4a-98e3-ef1bdcf41f80] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:32:39.852268 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-309f38bb-3337-4944-9f26-f3fb0b026cc9 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:32:39.852737 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-309f38bb-3337-4944-9f26-f3fb0b026cc9 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:32:39.853678 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-309f38bb-3337-4944-9f26-f3fb0b026cc9 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:32:39.854120 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-309f38bb-3337-4944-9f26-f3fb0b026cc9 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:32:39.868928 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.wsgi [None req-309f38bb-3337-4944-9f26-f3fb0b026cc9 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] HTTP exception thrown: Instance b45583dc-f18b-4b4a-98e3-ef1bdcf41f80 could not be found. Aug 04 05:32:39.870595 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-309f38bb-3337-4944-9f26-f3fb0b026cc9 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Request method failure captured: Aug 04 05:32:39.870595 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: request: GET /compute/v2.1/servers/b45583dc-f18b-4b4a-98e3-ef1bdcf41f80 HTTP/1.1 Aug 04 05:32:39.870595 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: Accept: application/json Aug 04 05:32:39.870595 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: Accept-Encoding: identity Aug 04 05:32:39.870595 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: Connection: close Aug 04 05:32:39.870595 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: Content-Length: 0 Aug 04 05:32:39.870595 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: Content-Type: application/json Aug 04 05:32:39.870595 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: Host: 10.222.0.46 Aug 04 05:32:39.870595 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: Openstack-System-Scope: None Aug 04 05:32:39.870595 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: User-Agent: python-urllib3/1.26.11 Aug 04 05:32:39.870595 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Auth-Token: gAAAAABi61g0x_8sFigG1jfXTOdqOMY1_3lK7UxaN3VmL5lqQXtIkCz4pWJYdYey2zGuiTigaV5gr0UWhaKZvxst4Kz-KOaAO64aM30ubWqVQfLIrJqf-RP6LF-c0ZabM-LUcJmxEmCuhHsUTEzNbVJn1WT0ja1hpuQC9pVY6l0Uzp1TYNzYyh0 Aug 04 05:32:39.870595 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Domain-Id: None Aug 04 05:32:39.870595 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Domain-Name: None Aug 04 05:32:39.870595 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Identity-Status: Confirmed Aug 04 05:32:39.870595 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Is-Admin-Project: True Aug 04 05:32:39.870595 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Project-Domain-Id: default Aug 04 05:32:39.870595 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Project-Domain-Name: Default Aug 04 05:32:39.870595 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Project-Id: faead990837d43de8ec54bfaf24361de Aug 04 05:32:39.870595 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Project-Name: tempest-AttachVolumeNegativeTest-710656709 Aug 04 05:32:39.870595 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Role: member,reader Aug 04 05:32:39.870595 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Roles: member,reader Aug 04 05:32:39.872100 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/faead990837d43de8ec54bfaf24361de"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/faead990837d43de8ec54bfaf24361de"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_faead990837d43de8ec54bfaf24361de", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/faead990837d43de8ec54bfaf24361de"}]}] Aug 04 05:32:39.872100 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Tenant: tempest-AttachVolumeNegativeTest-710656709 Aug 04 05:32:39.872100 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Tenant-Id: faead990837d43de8ec54bfaf24361de Aug 04 05:32:39.872100 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-710656709 Aug 04 05:32:39.872100 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-User: tempest-AttachVolumeNegativeTest-710656709-project Aug 04 05:32:39.872100 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-User-Domain-Id: default Aug 04 05:32:39.872100 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-User-Domain-Name: Default Aug 04 05:32:39.872100 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-User-Id: 9cb49b631c234f9a9fd47049b9b2e097 Aug 04 05:32:39.872100 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-User-Name: tempest-AttachVolumeNegativeTest-710656709-project Aug 04 05:32:39.872100 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: method: > Aug 04 05:32:39.872100 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: exception: Instance b45583dc-f18b-4b4a-98e3-ef1bdcf41f80 could not be found. Aug 04 05:32:39.872100 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: action_args: {'id': 'b45583dc-f18b-4b4a-98e3-ef1bdcf41f80'} Aug 04 05:32:39.872803 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 05:32:39.872803 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:32:39.872803 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 05:32:39.872803 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 05:32:39.872803 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 05:32:39.872803 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 05:32:39.872803 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 05:32:39.872803 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 05:32:39.872803 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 05:32:39.872803 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 05:32:39.872803 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b45583dc-f18b-4b4a-98e3-ef1bdcf41f80 could not be found. Aug 04 05:32:39.872803 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Aug 04 05:32:39.872803 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:32:39.872803 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Aug 04 05:32:39.872803 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:32:39.872803 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:32:39.872803 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:32:39.872803 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 05:32:39.872803 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 05:32:39.872803 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 05:32:39.873964 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 05:32:39.873964 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 05:32:39.873964 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 05:32:39.873964 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 05:32:39.873964 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 05:32:39.873964 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 05:32:39.873964 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 05:32:39.873964 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b45583dc-f18b-4b4a-98e3-ef1bdcf41f80 could not be found. Aug 04 05:32:39.873964 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Aug 04 05:32:39.873964 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:32:39.873964 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Aug 04 05:32:39.873964 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:32:39.873964 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:32:39.873964 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:32:39.873964 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 05:32:39.873964 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 05:32:39.873964 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b45583dc-f18b-4b4a-98e3-ef1bdcf41f80 could not be found. Aug 04 05:32:39.873964 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Aug 04 05:32:39.875064 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-309f38bb-3337-4944-9f26-f3fb0b026cc9 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Returning 404 to user: Instance b45583dc-f18b-4b4a-98e3-ef1bdcf41f80 could not be found. {{(pid=118476) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 05:32:39.875064 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-309f38bb-3337-4944-9f26-f3fb0b026cc9 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] 10.222.0.46 "GET /compute/v2.1/servers/b45583dc-f18b-4b4a-98e3-ef1bdcf41f80" status: 404 len: 111 microversion: 2.1 time: 0.031832 Aug 04 05:32:39.875064 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 394/792] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:32:39 2022] GET /compute/v2.1/servers/b45583dc-f18b-4b4a-98e3-ef1bdcf41f80 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 05:32:39.881202 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-27dd35b6-ea58-4395-8ca7-04e0ec70c50e tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:32:39.881733 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-27dd35b6-ea58-4395-8ca7-04e0ec70c50e tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] [instance: b7dd37ec-81bf-4c77-90dc-eecb897d9d19] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:32:39.887700 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-27dd35b6-ea58-4395-8ca7-04e0ec70c50e tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:32:39.888157 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-27dd35b6-ea58-4395-8ca7-04e0ec70c50e tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:32:39.888934 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-27dd35b6-ea58-4395-8ca7-04e0ec70c50e tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:32:39.889377 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-27dd35b6-ea58-4395-8ca7-04e0ec70c50e tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:32:39.903991 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.wsgi [None req-27dd35b6-ea58-4395-8ca7-04e0ec70c50e tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] HTTP exception thrown: Instance b7dd37ec-81bf-4c77-90dc-eecb897d9d19 could not be found. Aug 04 05:32:39.905543 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-27dd35b6-ea58-4395-8ca7-04e0ec70c50e tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Request method failure captured: Aug 04 05:32:39.905543 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: request: DELETE /compute/v2.1/servers/b7dd37ec-81bf-4c77-90dc-eecb897d9d19 HTTP/1.1 Aug 04 05:32:39.905543 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: Accept: application/json Aug 04 05:32:39.905543 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: Accept-Encoding: identity Aug 04 05:32:39.905543 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: Connection: close Aug 04 05:32:39.905543 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: Content-Length: 0 Aug 04 05:32:39.905543 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: Content-Type: application/json Aug 04 05:32:39.905543 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: Host: 10.222.0.46 Aug 04 05:32:39.905543 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: Openstack-System-Scope: None Aug 04 05:32:39.905543 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: User-Agent: python-urllib3/1.26.11 Aug 04 05:32:39.905543 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Auth-Token: gAAAAABi61g0x_8sFigG1jfXTOdqOMY1_3lK7UxaN3VmL5lqQXtIkCz4pWJYdYey2zGuiTigaV5gr0UWhaKZvxst4Kz-KOaAO64aM30ubWqVQfLIrJqf-RP6LF-c0ZabM-LUcJmxEmCuhHsUTEzNbVJn1WT0ja1hpuQC9pVY6l0Uzp1TYNzYyh0 Aug 04 05:32:39.905543 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Domain-Id: None Aug 04 05:32:39.905543 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Domain-Name: None Aug 04 05:32:39.905543 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Identity-Status: Confirmed Aug 04 05:32:39.905543 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Is-Admin-Project: True Aug 04 05:32:39.905543 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Project-Domain-Id: default Aug 04 05:32:39.905543 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Project-Domain-Name: Default Aug 04 05:32:39.905543 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Project-Id: faead990837d43de8ec54bfaf24361de Aug 04 05:32:39.905543 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Project-Name: tempest-AttachVolumeNegativeTest-710656709 Aug 04 05:32:39.905543 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Role: member,reader Aug 04 05:32:39.905543 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Roles: member,reader Aug 04 05:32:39.907243 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/faead990837d43de8ec54bfaf24361de"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/faead990837d43de8ec54bfaf24361de"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_faead990837d43de8ec54bfaf24361de", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/faead990837d43de8ec54bfaf24361de"}]}] Aug 04 05:32:39.907243 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Tenant: tempest-AttachVolumeNegativeTest-710656709 Aug 04 05:32:39.907243 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Tenant-Id: faead990837d43de8ec54bfaf24361de Aug 04 05:32:39.907243 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-710656709 Aug 04 05:32:39.907243 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-User: tempest-AttachVolumeNegativeTest-710656709-project Aug 04 05:32:39.907243 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-User-Domain-Id: default Aug 04 05:32:39.907243 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-User-Domain-Name: Default Aug 04 05:32:39.907243 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-User-Id: 9cb49b631c234f9a9fd47049b9b2e097 Aug 04 05:32:39.907243 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-User-Name: tempest-AttachVolumeNegativeTest-710656709-project Aug 04 05:32:39.907243 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: method: > Aug 04 05:32:39.907243 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: exception: Instance b7dd37ec-81bf-4c77-90dc-eecb897d9d19 could not be found. Aug 04 05:32:39.907243 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: action_args: {'id': 'b7dd37ec-81bf-4c77-90dc-eecb897d9d19'} Aug 04 05:32:39.908343 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 05:32:39.908343 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:32:39.908343 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 05:32:39.908343 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 05:32:39.908343 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 05:32:39.908343 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 05:32:39.908343 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 05:32:39.908343 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 05:32:39.908343 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 05:32:39.908343 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 05:32:39.908343 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b7dd37ec-81bf-4c77-90dc-eecb897d9d19 could not be found. Aug 04 05:32:39.908343 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Aug 04 05:32:39.908343 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:32:39.908343 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Aug 04 05:32:39.908343 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:32:39.908343 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:32:39.908343 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:32:39.908343 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 05:32:39.908343 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 05:32:39.908343 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 05:32:39.909560 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 05:32:39.909560 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 05:32:39.909560 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 05:32:39.909560 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 05:32:39.909560 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 05:32:39.909560 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 05:32:39.909560 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 05:32:39.909560 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 05:32:39.909560 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 05:32:39.909560 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b7dd37ec-81bf-4c77-90dc-eecb897d9d19 could not be found. Aug 04 05:32:39.909560 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Aug 04 05:32:39.909560 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:32:39.909560 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Aug 04 05:32:39.909560 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:32:39.909560 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:32:39.909560 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:32:39.909560 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 05:32:39.909560 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 05:32:39.909560 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b7dd37ec-81bf-4c77-90dc-eecb897d9d19 could not be found. Aug 04 05:32:39.909560 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Aug 04 05:32:39.911671 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-27dd35b6-ea58-4395-8ca7-04e0ec70c50e tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Returning 404 to user: Instance b7dd37ec-81bf-4c77-90dc-eecb897d9d19 could not be found. {{(pid=118476) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 05:32:39.911671 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-27dd35b6-ea58-4395-8ca7-04e0ec70c50e tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] 10.222.0.46 "DELETE /compute/v2.1/servers/b7dd37ec-81bf-4c77-90dc-eecb897d9d19" status: 404 len: 111 microversion: 2.1 time: 0.029591 Aug 04 05:32:39.911671 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 395/793] 10.222.0.46 () {58 vars in 1239 bytes} [Thu Aug 4 05:32:39 2022] DELETE /compute/v2.1/servers/b7dd37ec-81bf-4c77-90dc-eecb897d9d19 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 04 05:32:39.915318 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-985aaf7c-bc31-4bda-b0dc-4c96fd5bd2bd tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:32:39.915957 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-985aaf7c-bc31-4bda-b0dc-4c96fd5bd2bd tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] [instance: b7dd37ec-81bf-4c77-90dc-eecb897d9d19] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:32:39.921726 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-985aaf7c-bc31-4bda-b0dc-4c96fd5bd2bd tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:32:39.922172 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-985aaf7c-bc31-4bda-b0dc-4c96fd5bd2bd tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:32:39.922989 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-985aaf7c-bc31-4bda-b0dc-4c96fd5bd2bd tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:32:39.923447 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-985aaf7c-bc31-4bda-b0dc-4c96fd5bd2bd tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:32:39.937954 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.wsgi [None req-985aaf7c-bc31-4bda-b0dc-4c96fd5bd2bd tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] HTTP exception thrown: Instance b7dd37ec-81bf-4c77-90dc-eecb897d9d19 could not be found. Aug 04 05:32:39.942026 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-985aaf7c-bc31-4bda-b0dc-4c96fd5bd2bd tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Request method failure captured: Aug 04 05:32:39.942026 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: request: GET /compute/v2.1/servers/b7dd37ec-81bf-4c77-90dc-eecb897d9d19 HTTP/1.1 Aug 04 05:32:39.942026 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: Accept: application/json Aug 04 05:32:39.942026 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: Accept-Encoding: identity Aug 04 05:32:39.942026 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: Connection: close Aug 04 05:32:39.942026 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: Content-Length: 0 Aug 04 05:32:39.942026 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: Content-Type: application/json Aug 04 05:32:39.942026 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: Host: 10.222.0.46 Aug 04 05:32:39.942026 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: Openstack-System-Scope: None Aug 04 05:32:39.942026 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: User-Agent: python-urllib3/1.26.11 Aug 04 05:32:39.942026 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Auth-Token: gAAAAABi61g0x_8sFigG1jfXTOdqOMY1_3lK7UxaN3VmL5lqQXtIkCz4pWJYdYey2zGuiTigaV5gr0UWhaKZvxst4Kz-KOaAO64aM30ubWqVQfLIrJqf-RP6LF-c0ZabM-LUcJmxEmCuhHsUTEzNbVJn1WT0ja1hpuQC9pVY6l0Uzp1TYNzYyh0 Aug 04 05:32:39.942026 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Domain-Id: None Aug 04 05:32:39.942026 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Domain-Name: None Aug 04 05:32:39.942026 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Identity-Status: Confirmed Aug 04 05:32:39.942026 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Is-Admin-Project: True Aug 04 05:32:39.942026 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Project-Domain-Id: default Aug 04 05:32:39.942026 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Project-Domain-Name: Default Aug 04 05:32:39.942026 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Project-Id: faead990837d43de8ec54bfaf24361de Aug 04 05:32:39.942026 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Project-Name: tempest-AttachVolumeNegativeTest-710656709 Aug 04 05:32:39.942026 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Role: member,reader Aug 04 05:32:39.942026 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Roles: member,reader Aug 04 05:32:39.943810 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/faead990837d43de8ec54bfaf24361de"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/faead990837d43de8ec54bfaf24361de"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_faead990837d43de8ec54bfaf24361de", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/faead990837d43de8ec54bfaf24361de"}]}] Aug 04 05:32:39.943810 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Tenant: tempest-AttachVolumeNegativeTest-710656709 Aug 04 05:32:39.943810 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Tenant-Id: faead990837d43de8ec54bfaf24361de Aug 04 05:32:39.943810 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-710656709 Aug 04 05:32:39.943810 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-User: tempest-AttachVolumeNegativeTest-710656709-project Aug 04 05:32:39.943810 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-User-Domain-Id: default Aug 04 05:32:39.943810 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-User-Domain-Name: Default Aug 04 05:32:39.943810 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-User-Id: 9cb49b631c234f9a9fd47049b9b2e097 Aug 04 05:32:39.943810 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-User-Name: tempest-AttachVolumeNegativeTest-710656709-project Aug 04 05:32:39.943810 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: method: > Aug 04 05:32:39.943810 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: exception: Instance b7dd37ec-81bf-4c77-90dc-eecb897d9d19 could not be found. Aug 04 05:32:39.943810 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: action_args: {'id': 'b7dd37ec-81bf-4c77-90dc-eecb897d9d19'} Aug 04 05:32:39.944670 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 05:32:39.944670 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:32:39.944670 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 05:32:39.944670 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 05:32:39.944670 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 05:32:39.944670 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 05:32:39.944670 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 05:32:39.944670 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 05:32:39.944670 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 05:32:39.944670 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 05:32:39.944670 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b7dd37ec-81bf-4c77-90dc-eecb897d9d19 could not be found. Aug 04 05:32:39.944670 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Aug 04 05:32:39.944670 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:32:39.944670 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Aug 04 05:32:39.944670 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:32:39.944670 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:32:39.944670 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:32:39.944670 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 05:32:39.944670 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 05:32:39.944670 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 05:32:39.946909 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 05:32:39.946909 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 05:32:39.946909 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 05:32:39.946909 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 05:32:39.946909 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 05:32:39.946909 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 05:32:39.946909 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 05:32:39.946909 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b7dd37ec-81bf-4c77-90dc-eecb897d9d19 could not be found. Aug 04 05:32:39.946909 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Aug 04 05:32:39.946909 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:32:39.946909 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Aug 04 05:32:39.946909 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:32:39.946909 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:32:39.946909 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:32:39.946909 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 05:32:39.946909 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 05:32:39.946909 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b7dd37ec-81bf-4c77-90dc-eecb897d9d19 could not be found. Aug 04 05:32:39.946909 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Aug 04 05:32:39.948219 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-985aaf7c-bc31-4bda-b0dc-4c96fd5bd2bd tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Returning 404 to user: Instance b7dd37ec-81bf-4c77-90dc-eecb897d9d19 could not be found. {{(pid=118476) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 05:32:39.948219 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-985aaf7c-bc31-4bda-b0dc-4c96fd5bd2bd tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] 10.222.0.46 "GET /compute/v2.1/servers/b7dd37ec-81bf-4c77-90dc-eecb897d9d19" status: 404 len: 111 microversion: 2.1 time: 0.029841 Aug 04 05:32:39.948219 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 396/794] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:32:39 2022] GET /compute/v2.1/servers/b7dd37ec-81bf-4c77-90dc-eecb897d9d19 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 05:32:40.014602 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-953f1a84-81d3-4cd5-94c7-37935bd407e2 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb4dea95659c473b9b193c6234186430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1ca4b83dc874bda9f33e06f4910608c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:32:40.023389 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-953f1a84-81d3-4cd5-94c7-37935bd407e2 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] 10.222.0.46 "GET /compute/v2.1/servers/938a0d12-9045-4220-b0ee-a4ed0a3c4b6a" status: 200 len: 1672 microversion: 2.1 time: 0.668907 Aug 04 05:32:40.024078 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 399/795] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:32:39 2022] GET /compute/v2.1/servers/938a0d12-9045-4220-b0ee-a4ed0a3c4b6a => generated 1672 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:32:40.186949 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-ba6bdcbb-ebeb-4d0d-9a61-7ae4c1ffce9a tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:32:40.188132 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-ba6bdcbb-ebeb-4d0d-9a61-7ae4c1ffce9a tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] [instance: 8558ff08-5004-4dc4-892d-5b6610ce6bec] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:32:40.190911 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [req-ba2e7e6f-10f2-4cf6-9682-32241b159f8d req-520035b9-6a3c-44c7-833f-8af8b45a8ca7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8558ff08-5004-4dc4-892d-5b6610ce6bec", "tag": "f7d972aa-2cea-4611-b9c7-a3bf2025197a"}]} {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:32:40.198866 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-ba6bdcbb-ebeb-4d0d-9a61-7ae4c1ffce9a tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:32:40.199316 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-ba6bdcbb-ebeb-4d0d-9a61-7ae4c1ffce9a tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:32:40.200390 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-ba6bdcbb-ebeb-4d0d-9a61-7ae4c1ffce9a tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:32:40.201000 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-ba6bdcbb-ebeb-4d0d-9a61-7ae4c1ffce9a tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:32:40.205501 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [req-ba2e7e6f-10f2-4cf6-9682-32241b159f8d req-520035b9-6a3c-44c7-833f-8af8b45a8ca7 service nova] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:32:40.206733 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [req-ba2e7e6f-10f2-4cf6-9682-32241b159f8d req-520035b9-6a3c-44c7-833f-8af8b45a8ca7 service nova] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:32:40.239092 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-ba6bdcbb-ebeb-4d0d-9a61-7ae4c1ffce9a tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] [instance: 8558ff08-5004-4dc4-892d-5b6610ce6bec] Going to try to terminate instance {{(pid=118476) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 05:32:40.239947 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.compute.server_external_events [req-ba2e7e6f-10f2-4cf6-9682-32241b159f8d req-520035b9-6a3c-44c7-833f-8af8b45a8ca7 service nova] Creating event network-changed:f7d972aa-2cea-4611-b9c7-a3bf2025197a for instance 8558ff08-5004-4dc4-892d-5b6610ce6bec on hv-cinder-85207 Aug 04 05:32:40.254942 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [req-ba2e7e6f-10f2-4cf6-9682-32241b159f8d req-520035b9-6a3c-44c7-833f-8af8b45a8ca7 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068740 Aug 04 05:32:40.255560 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 400/796] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Aug 4 05:32:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:32:40.630808 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-ba6bdcbb-ebeb-4d0d-9a61-7ae4c1ffce9a tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] 10.222.0.46 "DELETE /compute/v2.1/servers/8558ff08-5004-4dc4-892d-5b6610ce6bec" status: 204 len: 0 microversion: 2.1 time: 0.449033 Aug 04 05:32:40.631692 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 397/797] 10.222.0.46 () {58 vars in 1239 bytes} [Thu Aug 4 05:32:40 2022] DELETE /compute/v2.1/servers/8558ff08-5004-4dc4-892d-5b6610ce6bec => generated 0 bytes in 451 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 05:32:40.641119 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-42473f1f-ee2e-4766-ab7e-852dc03708a2 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:32:40.642517 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-42473f1f-ee2e-4766-ab7e-852dc03708a2 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] [instance: 8558ff08-5004-4dc4-892d-5b6610ce6bec] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:32:40.653295 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-42473f1f-ee2e-4766-ab7e-852dc03708a2 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:32:40.655000 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-42473f1f-ee2e-4766-ab7e-852dc03708a2 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:32:40.656499 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-42473f1f-ee2e-4766-ab7e-852dc03708a2 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:32:40.663490 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-42473f1f-ee2e-4766-ab7e-852dc03708a2 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:32:40.827521 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-f2113e55-27e3-4b95-a6fa-cec1499df53c tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:32:40.831662 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-f2113e55-27e3-4b95-a6fa-cec1499df53c tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] [instance: 2e3bce83-6dff-479d-a54c-8f660fbbcdc5] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:32:40.859751 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-f2113e55-27e3-4b95-a6fa-cec1499df53c tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:32:40.860334 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-f2113e55-27e3-4b95-a6fa-cec1499df53c tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:32:40.862032 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-f2113e55-27e3-4b95-a6fa-cec1499df53c tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:32:40.863890 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-f2113e55-27e3-4b95-a6fa-cec1499df53c tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:32:41.075904 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-42473f1f-ee2e-4766-ab7e-852dc03708a2 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965cf2aad5bc4def9fca55aac87cc37e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32569df1dca45cebcdd63d03ff5abae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:32:41.109478 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-42473f1f-ee2e-4766-ab7e-852dc03708a2 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] 10.222.0.46 "GET /compute/v2.1/servers/8558ff08-5004-4dc4-892d-5b6610ce6bec" status: 200 len: 1569 microversion: 2.1 time: 0.472880 Aug 04 05:32:41.118702 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 401/798] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:32:40 2022] GET /compute/v2.1/servers/8558ff08-5004-4dc4-892d-5b6610ce6bec => generated 1569 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:32:41.135071 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-31be4064-277b-4671-b979-32609bd67c91 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:32:41.135949 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-31be4064-277b-4671-b979-32609bd67c91 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] [instance: 938a0d12-9045-4220-b0ee-a4ed0a3c4b6a] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:32:41.154654 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-31be4064-277b-4671-b979-32609bd67c91 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:32:41.155515 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-31be4064-277b-4671-b979-32609bd67c91 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:32:41.158648 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-31be4064-277b-4671-b979-32609bd67c91 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:32:41.161447 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-31be4064-277b-4671-b979-32609bd67c91 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:32:41.325455 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-f2113e55-27e3-4b95-a6fa-cec1499df53c tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:32:41.346817 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-31be4064-277b-4671-b979-32609bd67c91 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb4dea95659c473b9b193c6234186430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1ca4b83dc874bda9f33e06f4910608c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:32:41.357190 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-f2113e55-27e3-4b95-a6fa-cec1499df53c tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:32:41.364137 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-f2113e55-27e3-4b95-a6fa-cec1499df53c tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:32:41.365550 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-31be4064-277b-4671-b979-32609bd67c91 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] 10.222.0.46 "GET /compute/v2.1/servers/938a0d12-9045-4220-b0ee-a4ed0a3c4b6a" status: 200 len: 1604 microversion: 2.1 time: 0.241258 Aug 04 05:32:41.367179 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 402/799] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:32:41 2022] GET /compute/v2.1/servers/938a0d12-9045-4220-b0ee-a4ed0a3c4b6a => generated 1604 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:32:41.368995 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-f2113e55-27e3-4b95-a6fa-cec1499df53c tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] 10.222.0.46 "GET /compute/v2.1/servers/2e3bce83-6dff-479d-a54c-8f660fbbcdc5" status: 200 len: 1740 microversion: 2.20 time: 0.554982 Aug 04 05:32:41.373979 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 398/800] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Aug 4 05:32:40 2022] GET /compute/v2.1/servers/2e3bce83-6dff-479d-a54c-8f660fbbcdc5 => generated 1740 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 05:32:41.376032 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-226b8a9e-e56c-4113-9e05-162bf6a8fb0d tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:32:41.377559 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-226b8a9e-e56c-4113-9e05-162bf6a8fb0d tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] [instance: 384721d7-1467-45cd-af93-eb458115f75e] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:32:41.385786 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-226b8a9e-e56c-4113-9e05-162bf6a8fb0d tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:32:41.387385 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-226b8a9e-e56c-4113-9e05-162bf6a8fb0d tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:32:41.388496 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-226b8a9e-e56c-4113-9e05-162bf6a8fb0d tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:32:41.391341 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-226b8a9e-e56c-4113-9e05-162bf6a8fb0d tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:32:41.410226 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.wsgi [None req-226b8a9e-e56c-4113-9e05-162bf6a8fb0d tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] HTTP exception thrown: Instance 384721d7-1467-45cd-af93-eb458115f75e could not be found. Aug 04 05:32:41.412444 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-226b8a9e-e56c-4113-9e05-162bf6a8fb0d tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Request method failure captured: Aug 04 05:32:41.412444 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: request: DELETE /compute/v2.1/servers/384721d7-1467-45cd-af93-eb458115f75e HTTP/1.1 Aug 04 05:32:41.412444 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: Accept: application/json Aug 04 05:32:41.412444 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: Accept-Encoding: identity Aug 04 05:32:41.412444 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: Connection: close Aug 04 05:32:41.412444 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: Content-Length: 0 Aug 04 05:32:41.412444 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: Content-Type: application/json Aug 04 05:32:41.412444 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: Host: 10.222.0.46 Aug 04 05:32:41.412444 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: Openstack-System-Scope: None Aug 04 05:32:41.412444 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: User-Agent: python-urllib3/1.26.11 Aug 04 05:32:41.412444 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Auth-Token: gAAAAABi61g0x_8sFigG1jfXTOdqOMY1_3lK7UxaN3VmL5lqQXtIkCz4pWJYdYey2zGuiTigaV5gr0UWhaKZvxst4Kz-KOaAO64aM30ubWqVQfLIrJqf-RP6LF-c0ZabM-LUcJmxEmCuhHsUTEzNbVJn1WT0ja1hpuQC9pVY6l0Uzp1TYNzYyh0 Aug 04 05:32:41.412444 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Domain-Id: None Aug 04 05:32:41.412444 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Domain-Name: None Aug 04 05:32:41.412444 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Identity-Status: Confirmed Aug 04 05:32:41.412444 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Is-Admin-Project: True Aug 04 05:32:41.412444 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Project-Domain-Id: default Aug 04 05:32:41.412444 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Project-Domain-Name: Default Aug 04 05:32:41.412444 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Project-Id: faead990837d43de8ec54bfaf24361de Aug 04 05:32:41.412444 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Project-Name: tempest-AttachVolumeNegativeTest-710656709 Aug 04 05:32:41.412444 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Role: member,reader Aug 04 05:32:41.412444 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Roles: member,reader Aug 04 05:32:41.413746 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/faead990837d43de8ec54bfaf24361de"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/faead990837d43de8ec54bfaf24361de"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_faead990837d43de8ec54bfaf24361de", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/faead990837d43de8ec54bfaf24361de"}]}] Aug 04 05:32:41.413746 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Tenant: tempest-AttachVolumeNegativeTest-710656709 Aug 04 05:32:41.413746 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Tenant-Id: faead990837d43de8ec54bfaf24361de Aug 04 05:32:41.413746 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-710656709 Aug 04 05:32:41.413746 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-User: tempest-AttachVolumeNegativeTest-710656709-project Aug 04 05:32:41.413746 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-User-Domain-Id: default Aug 04 05:32:41.413746 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-User-Domain-Name: Default Aug 04 05:32:41.413746 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-User-Id: 9cb49b631c234f9a9fd47049b9b2e097 Aug 04 05:32:41.413746 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-User-Name: tempest-AttachVolumeNegativeTest-710656709-project Aug 04 05:32:41.413746 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: method: > Aug 04 05:32:41.413746 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: exception: Instance 384721d7-1467-45cd-af93-eb458115f75e could not be found. Aug 04 05:32:41.413746 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: action_args: {'id': '384721d7-1467-45cd-af93-eb458115f75e'} Aug 04 05:32:41.414544 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 05:32:41.414544 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:32:41.414544 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 05:32:41.414544 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 05:32:41.414544 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 05:32:41.414544 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 05:32:41.414544 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 05:32:41.414544 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 05:32:41.414544 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 05:32:41.414544 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 05:32:41.414544 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 384721d7-1467-45cd-af93-eb458115f75e could not be found. Aug 04 05:32:41.414544 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Aug 04 05:32:41.414544 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:32:41.414544 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Aug 04 05:32:41.414544 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:32:41.414544 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:32:41.414544 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:32:41.414544 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 05:32:41.414544 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 05:32:41.414544 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 05:32:41.415704 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 05:32:41.415704 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 05:32:41.415704 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 05:32:41.415704 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 05:32:41.415704 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 05:32:41.415704 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 05:32:41.415704 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 05:32:41.415704 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 05:32:41.415704 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 05:32:41.415704 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 384721d7-1467-45cd-af93-eb458115f75e could not be found. Aug 04 05:32:41.415704 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Aug 04 05:32:41.415704 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:32:41.415704 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Aug 04 05:32:41.415704 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:32:41.415704 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:32:41.415704 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:32:41.415704 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 05:32:41.415704 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 05:32:41.415704 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 384721d7-1467-45cd-af93-eb458115f75e could not be found. Aug 04 05:32:41.415704 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Aug 04 05:32:41.420050 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-226b8a9e-e56c-4113-9e05-162bf6a8fb0d tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Returning 404 to user: Instance 384721d7-1467-45cd-af93-eb458115f75e could not be found. {{(pid=118477) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 05:32:41.421169 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-226b8a9e-e56c-4113-9e05-162bf6a8fb0d tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] 10.222.0.46 "DELETE /compute/v2.1/servers/384721d7-1467-45cd-af93-eb458115f75e" status: 404 len: 111 microversion: 2.1 time: 0.050752 Aug 04 05:32:41.421852 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 403/801] 10.222.0.46 () {58 vars in 1239 bytes} [Thu Aug 4 05:32:41 2022] DELETE /compute/v2.1/servers/384721d7-1467-45cd-af93-eb458115f75e => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 05:32:41.436324 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-d8471235-f84b-43ec-85f5-d7ead8a02aa7 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:32:41.438617 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-d8471235-f84b-43ec-85f5-d7ead8a02aa7 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] [instance: 384721d7-1467-45cd-af93-eb458115f75e] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:32:41.446037 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-d8471235-f84b-43ec-85f5-d7ead8a02aa7 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:32:41.446937 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-d8471235-f84b-43ec-85f5-d7ead8a02aa7 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:32:41.447733 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-d8471235-f84b-43ec-85f5-d7ead8a02aa7 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:32:41.448173 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-d8471235-f84b-43ec-85f5-d7ead8a02aa7 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:32:41.463594 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.wsgi [None req-d8471235-f84b-43ec-85f5-d7ead8a02aa7 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] HTTP exception thrown: Instance 384721d7-1467-45cd-af93-eb458115f75e could not be found. Aug 04 05:32:41.465246 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-d8471235-f84b-43ec-85f5-d7ead8a02aa7 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Request method failure captured: Aug 04 05:32:41.465246 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: request: GET /compute/v2.1/servers/384721d7-1467-45cd-af93-eb458115f75e HTTP/1.1 Aug 04 05:32:41.465246 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: Accept: application/json Aug 04 05:32:41.465246 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: Accept-Encoding: identity Aug 04 05:32:41.465246 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: Connection: close Aug 04 05:32:41.465246 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: Content-Length: 0 Aug 04 05:32:41.465246 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: Content-Type: application/json Aug 04 05:32:41.465246 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: Host: 10.222.0.46 Aug 04 05:32:41.465246 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: Openstack-System-Scope: None Aug 04 05:32:41.465246 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: User-Agent: python-urllib3/1.26.11 Aug 04 05:32:41.465246 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Auth-Token: gAAAAABi61g0x_8sFigG1jfXTOdqOMY1_3lK7UxaN3VmL5lqQXtIkCz4pWJYdYey2zGuiTigaV5gr0UWhaKZvxst4Kz-KOaAO64aM30ubWqVQfLIrJqf-RP6LF-c0ZabM-LUcJmxEmCuhHsUTEzNbVJn1WT0ja1hpuQC9pVY6l0Uzp1TYNzYyh0 Aug 04 05:32:41.465246 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Domain-Id: None Aug 04 05:32:41.465246 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Domain-Name: None Aug 04 05:32:41.465246 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Identity-Status: Confirmed Aug 04 05:32:41.465246 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Is-Admin-Project: True Aug 04 05:32:41.465246 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Project-Domain-Id: default Aug 04 05:32:41.465246 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Project-Domain-Name: Default Aug 04 05:32:41.465246 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Project-Id: faead990837d43de8ec54bfaf24361de Aug 04 05:32:41.465246 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Project-Name: tempest-AttachVolumeNegativeTest-710656709 Aug 04 05:32:41.465246 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Role: member,reader Aug 04 05:32:41.465246 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Roles: member,reader Aug 04 05:32:41.466591 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/faead990837d43de8ec54bfaf24361de"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/faead990837d43de8ec54bfaf24361de"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_faead990837d43de8ec54bfaf24361de", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/faead990837d43de8ec54bfaf24361de"}]}] Aug 04 05:32:41.466591 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Tenant: tempest-AttachVolumeNegativeTest-710656709 Aug 04 05:32:41.466591 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Tenant-Id: faead990837d43de8ec54bfaf24361de Aug 04 05:32:41.466591 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-710656709 Aug 04 05:32:41.466591 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-User: tempest-AttachVolumeNegativeTest-710656709-project Aug 04 05:32:41.466591 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-User-Domain-Id: default Aug 04 05:32:41.466591 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-User-Domain-Name: Default Aug 04 05:32:41.466591 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-User-Id: 9cb49b631c234f9a9fd47049b9b2e097 Aug 04 05:32:41.466591 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-User-Name: tempest-AttachVolumeNegativeTest-710656709-project Aug 04 05:32:41.466591 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: method: > Aug 04 05:32:41.466591 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: exception: Instance 384721d7-1467-45cd-af93-eb458115f75e could not be found. Aug 04 05:32:41.466591 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: action_args: {'id': '384721d7-1467-45cd-af93-eb458115f75e'} Aug 04 05:32:41.472709 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 05:32:41.472709 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:32:41.472709 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 05:32:41.472709 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 05:32:41.472709 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 05:32:41.472709 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 05:32:41.472709 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 05:32:41.472709 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 05:32:41.472709 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 05:32:41.472709 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 05:32:41.472709 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 384721d7-1467-45cd-af93-eb458115f75e could not be found. Aug 04 05:32:41.472709 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Aug 04 05:32:41.472709 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:32:41.472709 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Aug 04 05:32:41.472709 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:32:41.472709 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:32:41.472709 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:32:41.472709 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 05:32:41.472709 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 05:32:41.472709 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 05:32:41.474707 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 05:32:41.474707 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 05:32:41.474707 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 05:32:41.474707 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 05:32:41.474707 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 05:32:41.474707 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 05:32:41.474707 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 05:32:41.474707 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 384721d7-1467-45cd-af93-eb458115f75e could not be found. Aug 04 05:32:41.474707 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Aug 04 05:32:41.474707 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:32:41.474707 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Aug 04 05:32:41.474707 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:32:41.474707 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:32:41.474707 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:32:41.474707 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 05:32:41.474707 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 05:32:41.474707 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 384721d7-1467-45cd-af93-eb458115f75e could not be found. Aug 04 05:32:41.474707 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Aug 04 05:32:41.477903 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-d8471235-f84b-43ec-85f5-d7ead8a02aa7 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] Returning 404 to user: Instance 384721d7-1467-45cd-af93-eb458115f75e could not be found. {{(pid=118476) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 05:32:41.477903 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-d8471235-f84b-43ec-85f5-d7ead8a02aa7 tempest-AttachVolumeNegativeTest-710656709 tempest-AttachVolumeNegativeTest-710656709-project] 10.222.0.46 "GET /compute/v2.1/servers/384721d7-1467-45cd-af93-eb458115f75e" status: 404 len: 111 microversion: 2.1 time: 0.040195 Aug 04 05:32:41.477903 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 399/802] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:32:41 2022] GET /compute/v2.1/servers/384721d7-1467-45cd-af93-eb458115f75e => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 05:32:42.141231 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-fdbad935-c206-4da8-9e2f-7e633881c516 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:32:42.142486 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-fdbad935-c206-4da8-9e2f-7e633881c516 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] [instance: 8558ff08-5004-4dc4-892d-5b6610ce6bec] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:32:42.150467 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-fdbad935-c206-4da8-9e2f-7e633881c516 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:32:42.151293 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-fdbad935-c206-4da8-9e2f-7e633881c516 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:32:42.152411 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-fdbad935-c206-4da8-9e2f-7e633881c516 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:32:42.153135 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-fdbad935-c206-4da8-9e2f-7e633881c516 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:32:42.297372 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [req-933a4322-415e-455f-aae3-47ec2111b330 req-72ef36be-4edf-49f6-b025-cd38ccad2a03 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "938a0d12-9045-4220-b0ee-a4ed0a3c4b6a", "name": "network-vif-deleted", "tag": "96eaa044-09b6-458e-884c-ed2bb97c5253"}]} {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:32:42.308824 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [req-933a4322-415e-455f-aae3-47ec2111b330 req-72ef36be-4edf-49f6-b025-cd38ccad2a03 service nova] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:32:42.309375 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [req-933a4322-415e-455f-aae3-47ec2111b330 req-72ef36be-4edf-49f6-b025-cd38ccad2a03 service nova] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:32:42.327787 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.compute.server_external_events [req-933a4322-415e-455f-aae3-47ec2111b330 req-72ef36be-4edf-49f6-b025-cd38ccad2a03 service nova] Creating event network-vif-deleted:96eaa044-09b6-458e-884c-ed2bb97c5253 for instance 938a0d12-9045-4220-b0ee-a4ed0a3c4b6a on hv-cinder-85207 Aug 04 05:32:42.334693 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [req-933a4322-415e-455f-aae3-47ec2111b330 req-72ef36be-4edf-49f6-b025-cd38ccad2a03 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042523 Aug 04 05:32:42.335707 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 400/803] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Aug 4 05:32:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 05:32:42.394987 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-26952157-007d-4c3f-98db-eea12e6c6b52 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:32:42.396022 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-26952157-007d-4c3f-98db-eea12e6c6b52 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] [instance: 938a0d12-9045-4220-b0ee-a4ed0a3c4b6a] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:32:42.403203 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-26952157-007d-4c3f-98db-eea12e6c6b52 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:32:42.404171 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-26952157-007d-4c3f-98db-eea12e6c6b52 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:32:42.405166 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-26952157-007d-4c3f-98db-eea12e6c6b52 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:32:42.405701 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-26952157-007d-4c3f-98db-eea12e6c6b52 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:32:42.406767 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-fdbad935-c206-4da8-9e2f-7e633881c516 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965cf2aad5bc4def9fca55aac87cc37e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32569df1dca45cebcdd63d03ff5abae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:32:42.419284 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-fdbad935-c206-4da8-9e2f-7e633881c516 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] 10.222.0.46 "GET /compute/v2.1/servers/8558ff08-5004-4dc4-892d-5b6610ce6bec" status: 200 len: 1569 microversion: 2.1 time: 0.281828 Aug 04 05:32:42.420431 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 404/804] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:32:42 2022] GET /compute/v2.1/servers/8558ff08-5004-4dc4-892d-5b6610ce6bec => generated 1569 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:32:42.426507 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-4054878a-8c6b-4ee7-b986-5c95cce57277 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:32:42.427115 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-4054878a-8c6b-4ee7-b986-5c95cce57277 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] [instance: 2e3bce83-6dff-479d-a54c-8f660fbbcdc5] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:32:42.433029 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-4054878a-8c6b-4ee7-b986-5c95cce57277 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:32:42.433681 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-4054878a-8c6b-4ee7-b986-5c95cce57277 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:32:42.434771 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-4054878a-8c6b-4ee7-b986-5c95cce57277 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:32:42.435372 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-4054878a-8c6b-4ee7-b986-5c95cce57277 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:32:42.474558 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-26952157-007d-4c3f-98db-eea12e6c6b52 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:32:42.475267 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-26952157-007d-4c3f-98db-eea12e6c6b52 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:32:42.475727 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.objects.instance [None req-26952157-007d-4c3f-98db-eea12e6c6b52 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lazy-loading 'fault' on Instance uuid 938a0d12-9045-4220-b0ee-a4ed0a3c4b6a {{(pid=118476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 05:32:42.557736 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-26952157-007d-4c3f-98db-eea12e6c6b52 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb4dea95659c473b9b193c6234186430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1ca4b83dc874bda9f33e06f4910608c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:32:42.566092 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-26952157-007d-4c3f-98db-eea12e6c6b52 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] 10.222.0.46 "GET /compute/v2.1/servers/938a0d12-9045-4220-b0ee-a4ed0a3c4b6a" status: 200 len: 1327 microversion: 2.1 time: 0.176455 Aug 04 05:32:42.566829 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 401/805] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:32:42 2022] GET /compute/v2.1/servers/938a0d12-9045-4220-b0ee-a4ed0a3c4b6a => generated 1327 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:32:42.638554 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-4054878a-8c6b-4ee7-b986-5c95cce57277 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:32:42.667270 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-4054878a-8c6b-4ee7-b986-5c95cce57277 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:32:42.667270 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-4054878a-8c6b-4ee7-b986-5c95cce57277 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:32:42.667270 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-4054878a-8c6b-4ee7-b986-5c95cce57277 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] 10.222.0.46 "GET /compute/v2.1/servers/2e3bce83-6dff-479d-a54c-8f660fbbcdc5" status: 200 len: 1740 microversion: 2.20 time: 0.229743 Aug 04 05:32:42.667575 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 405/806] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Aug 4 05:32:42 2022] GET /compute/v2.1/servers/2e3bce83-6dff-479d-a54c-8f660fbbcdc5 => generated 1740 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 05:32:43.444902 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-3d5b3209-9db6-4d6f-82d5-b29c88036bb3 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:32:43.449741 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-3d5b3209-9db6-4d6f-82d5-b29c88036bb3 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] [instance: 8558ff08-5004-4dc4-892d-5b6610ce6bec] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:32:43.459202 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-3d5b3209-9db6-4d6f-82d5-b29c88036bb3 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:32:43.465392 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-3d5b3209-9db6-4d6f-82d5-b29c88036bb3 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:32:43.465392 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-3d5b3209-9db6-4d6f-82d5-b29c88036bb3 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:32:43.465392 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-3d5b3209-9db6-4d6f-82d5-b29c88036bb3 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:32:43.588117 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-7b8b1db2-96d8-48a3-8707-e27ab4817115 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:32:43.589532 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-7b8b1db2-96d8-48a3-8707-e27ab4817115 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] [instance: 938a0d12-9045-4220-b0ee-a4ed0a3c4b6a] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:32:43.614132 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-7b8b1db2-96d8-48a3-8707-e27ab4817115 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:32:43.614132 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-7b8b1db2-96d8-48a3-8707-e27ab4817115 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:32:43.614132 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-7b8b1db2-96d8-48a3-8707-e27ab4817115 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:32:43.615570 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-7b8b1db2-96d8-48a3-8707-e27ab4817115 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:32:43.647962 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.wsgi [None req-7b8b1db2-96d8-48a3-8707-e27ab4817115 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] HTTP exception thrown: Instance 938a0d12-9045-4220-b0ee-a4ed0a3c4b6a could not be found. Aug 04 05:32:43.657998 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-7b8b1db2-96d8-48a3-8707-e27ab4817115 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Request method failure captured: Aug 04 05:32:43.657998 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: request: GET /compute/v2.1/servers/938a0d12-9045-4220-b0ee-a4ed0a3c4b6a HTTP/1.1 Aug 04 05:32:43.657998 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: Accept: application/json Aug 04 05:32:43.657998 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: Accept-Encoding: identity Aug 04 05:32:43.657998 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: Connection: close Aug 04 05:32:43.657998 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: Content-Length: 0 Aug 04 05:32:43.657998 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: Content-Type: application/json Aug 04 05:32:43.657998 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: Host: 10.222.0.46 Aug 04 05:32:43.657998 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: Openstack-System-Scope: None Aug 04 05:32:43.657998 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: User-Agent: python-urllib3/1.26.11 Aug 04 05:32:43.657998 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Auth-Token: gAAAAABi61ibB27zcAqkTFBz3ZHZQBTyYLUiz1L71kTAJ1mIgw23NzfP3be8JfDUo2j8H621Gq4ZtR6Qkl_uc57pKHyYmWoyApQ0u1rcdhH843jVllSfSpyjvEna5qAHPkZneB2RW8yXCDwaidRZA-fexzYeio0C9gcFg53_Z47USjhBWgHa8uc Aug 04 05:32:43.657998 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Domain-Id: None Aug 04 05:32:43.657998 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Domain-Name: None Aug 04 05:32:43.657998 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Identity-Status: Confirmed Aug 04 05:32:43.657998 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Is-Admin-Project: True Aug 04 05:32:43.657998 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Project-Domain-Id: default Aug 04 05:32:43.657998 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Project-Domain-Name: Default Aug 04 05:32:43.657998 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Project-Id: d1ca4b83dc874bda9f33e06f4910608c Aug 04 05:32:43.657998 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Project-Name: tempest-AttachVolumeTestJSON-785443369 Aug 04 05:32:43.657998 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Role: member,reader Aug 04 05:32:43.657998 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Roles: member,reader Aug 04 05:32:43.663695 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/d1ca4b83dc874bda9f33e06f4910608c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/d1ca4b83dc874bda9f33e06f4910608c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_d1ca4b83dc874bda9f33e06f4910608c", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/d1ca4b83dc874bda9f33e06f4910608c"}]}] Aug 04 05:32:43.663695 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Tenant: tempest-AttachVolumeTestJSON-785443369 Aug 04 05:32:43.663695 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Tenant-Id: d1ca4b83dc874bda9f33e06f4910608c Aug 04 05:32:43.663695 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Tenant-Name: tempest-AttachVolumeTestJSON-785443369 Aug 04 05:32:43.663695 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-User: tempest-AttachVolumeTestJSON-785443369-project Aug 04 05:32:43.663695 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-User-Domain-Id: default Aug 04 05:32:43.663695 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-User-Domain-Name: Default Aug 04 05:32:43.663695 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-User-Id: eb4dea95659c473b9b193c6234186430 Aug 04 05:32:43.663695 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-User-Name: tempest-AttachVolumeTestJSON-785443369-project Aug 04 05:32:43.663695 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: method: > Aug 04 05:32:43.663695 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: exception: Instance 938a0d12-9045-4220-b0ee-a4ed0a3c4b6a could not be found. Aug 04 05:32:43.663695 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: action_args: {'id': '938a0d12-9045-4220-b0ee-a4ed0a3c4b6a'} Aug 04 05:32:43.664679 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 05:32:43.664679 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:32:43.664679 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 05:32:43.664679 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 05:32:43.664679 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 05:32:43.664679 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 05:32:43.664679 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 05:32:43.664679 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 05:32:43.664679 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 05:32:43.664679 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 05:32:43.664679 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 938a0d12-9045-4220-b0ee-a4ed0a3c4b6a could not be found. Aug 04 05:32:43.664679 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Aug 04 05:32:43.664679 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:32:43.664679 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Aug 04 05:32:43.664679 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:32:43.664679 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:32:43.664679 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:32:43.664679 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 05:32:43.664679 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 05:32:43.664679 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 05:32:43.665964 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 05:32:43.665964 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 05:32:43.665964 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 05:32:43.665964 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 05:32:43.665964 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 05:32:43.665964 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 05:32:43.665964 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 05:32:43.665964 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 938a0d12-9045-4220-b0ee-a4ed0a3c4b6a could not be found. Aug 04 05:32:43.665964 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Aug 04 05:32:43.665964 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:32:43.665964 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Aug 04 05:32:43.665964 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:32:43.665964 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:32:43.665964 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:32:43.665964 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 05:32:43.665964 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 05:32:43.665964 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 938a0d12-9045-4220-b0ee-a4ed0a3c4b6a could not be found. Aug 04 05:32:43.665964 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Aug 04 05:32:43.667177 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-7b8b1db2-96d8-48a3-8707-e27ab4817115 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Returning 404 to user: Instance 938a0d12-9045-4220-b0ee-a4ed0a3c4b6a could not be found. {{(pid=118477) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 05:32:43.667177 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-7b8b1db2-96d8-48a3-8707-e27ab4817115 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] 10.222.0.46 "GET /compute/v2.1/servers/938a0d12-9045-4220-b0ee-a4ed0a3c4b6a" status: 404 len: 111 microversion: 2.1 time: 0.076530 Aug 04 05:32:43.669164 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 406/807] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:32:43 2022] GET /compute/v2.1/servers/938a0d12-9045-4220-b0ee-a4ed0a3c4b6a => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 05:32:43.679881 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-6bf165cf-cd90-4b97-92cb-ab0e526d1ea5 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Calling method '.version_select at 0x7f1475599b80>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:32:43.796200 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-6bf165cf-cd90-4b97-92cb-ab0e526d1ea5 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1130835071" status: 202 len: 0 microversion: 2.1 time: 0.123126 Aug 04 05:32:43.803656 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 407/808] 10.222.0.46 () {58 vars in 1221 bytes} [Thu Aug 4 05:32:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1130835071 => generated 0 bytes in 127 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 05:32:43.803656 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-5dd4a39d-4cb3-4f09-9ed0-1fc90a1a43b8 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:32:43.803656 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-5dd4a39d-4cb3-4f09-9ed0-1fc90a1a43b8 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] [instance: 2e3bce83-6dff-479d-a54c-8f660fbbcdc5] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:32:43.813185 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-5dd4a39d-4cb3-4f09-9ed0-1fc90a1a43b8 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:32:43.814643 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-5dd4a39d-4cb3-4f09-9ed0-1fc90a1a43b8 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:32:43.816142 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-5dd4a39d-4cb3-4f09-9ed0-1fc90a1a43b8 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:32:43.816816 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-5dd4a39d-4cb3-4f09-9ed0-1fc90a1a43b8 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:32:43.904822 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-3d5b3209-9db6-4d6f-82d5-b29c88036bb3 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965cf2aad5bc4def9fca55aac87cc37e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32569df1dca45cebcdd63d03ff5abae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:32:43.925678 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-3d5b3209-9db6-4d6f-82d5-b29c88036bb3 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] 10.222.0.46 "GET /compute/v2.1/servers/8558ff08-5004-4dc4-892d-5b6610ce6bec" status: 200 len: 1383 microversion: 2.1 time: 0.483846 Aug 04 05:32:43.926691 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 402/809] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:32:43 2022] GET /compute/v2.1/servers/8558ff08-5004-4dc4-892d-5b6610ce6bec => generated 1383 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:32:44.246723 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-5dd4a39d-4cb3-4f09-9ed0-1fc90a1a43b8 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:32:44.255206 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-5dd4a39d-4cb3-4f09-9ed0-1fc90a1a43b8 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:32:44.256738 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-5dd4a39d-4cb3-4f09-9ed0-1fc90a1a43b8 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:32:44.257905 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-5dd4a39d-4cb3-4f09-9ed0-1fc90a1a43b8 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] 10.222.0.46 "GET /compute/v2.1/servers/2e3bce83-6dff-479d-a54c-8f660fbbcdc5" status: 200 len: 1722 microversion: 2.20 time: 0.459883 Aug 04 05:32:44.258494 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 408/810] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Aug 4 05:32:43 2022] GET /compute/v2.1/servers/2e3bce83-6dff-479d-a54c-8f660fbbcdc5 => generated 1722 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 05:32:44.360724 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [req-3e219433-29e7-4a93-884b-3f6e20e4057a req-79f2bad5-06e2-43a7-bbbc-985e5d50befd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8558ff08-5004-4dc4-892d-5b6610ce6bec", "name": "network-vif-deleted", "tag": "f7d972aa-2cea-4611-b9c7-a3bf2025197a"}]} {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:32:44.370833 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [req-3e219433-29e7-4a93-884b-3f6e20e4057a req-79f2bad5-06e2-43a7-bbbc-985e5d50befd service nova] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:32:44.371271 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [req-3e219433-29e7-4a93-884b-3f6e20e4057a req-79f2bad5-06e2-43a7-bbbc-985e5d50befd service nova] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:32:44.389178 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.compute.server_external_events [req-3e219433-29e7-4a93-884b-3f6e20e4057a req-79f2bad5-06e2-43a7-bbbc-985e5d50befd service nova] Creating event network-vif-deleted:f7d972aa-2cea-4611-b9c7-a3bf2025197a for instance 8558ff08-5004-4dc4-892d-5b6610ce6bec on hv-cinder-85207 Aug 04 05:32:44.399070 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [req-3e219433-29e7-4a93-884b-3f6e20e4057a req-79f2bad5-06e2-43a7-bbbc-985e5d50befd service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044896 Aug 04 05:32:44.399888 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 403/811] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Aug 4 05:32:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 05:32:44.950361 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-7597165a-da78-4fe8-a720-459059639b41 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:32:44.955789 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-7597165a-da78-4fe8-a720-459059639b41 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] [instance: 8558ff08-5004-4dc4-892d-5b6610ce6bec] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:32:44.972438 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-7597165a-da78-4fe8-a720-459059639b41 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:32:44.973002 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-7597165a-da78-4fe8-a720-459059639b41 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:32:44.973824 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-7597165a-da78-4fe8-a720-459059639b41 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:32:44.974233 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-7597165a-da78-4fe8-a720-459059639b41 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:32:45.064865 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-7597165a-da78-4fe8-a720-459059639b41 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965cf2aad5bc4def9fca55aac87cc37e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32569df1dca45cebcdd63d03ff5abae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:32:45.076037 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-7597165a-da78-4fe8-a720-459059639b41 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] 10.222.0.46 "GET /compute/v2.1/servers/8558ff08-5004-4dc4-892d-5b6610ce6bec" status: 200 len: 1219 microversion: 2.1 time: 0.130645 Aug 04 05:32:45.076037 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 409/812] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:32:44 2022] GET /compute/v2.1/servers/8558ff08-5004-4dc4-892d-5b6610ce6bec => generated 1219 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:32:45.288037 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-3792072c-6969-4038-8f3a-fcfe6ec7b4f8 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:32:45.288892 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-3792072c-6969-4038-8f3a-fcfe6ec7b4f8 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] [instance: 2e3bce83-6dff-479d-a54c-8f660fbbcdc5] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:32:45.300131 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-3792072c-6969-4038-8f3a-fcfe6ec7b4f8 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:32:45.301375 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-3792072c-6969-4038-8f3a-fcfe6ec7b4f8 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:32:45.302266 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-3792072c-6969-4038-8f3a-fcfe6ec7b4f8 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:32:45.302870 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-3792072c-6969-4038-8f3a-fcfe6ec7b4f8 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:32:45.467120 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-3792072c-6969-4038-8f3a-fcfe6ec7b4f8 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:32:45.477276 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-3792072c-6969-4038-8f3a-fcfe6ec7b4f8 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:32:45.479465 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-3792072c-6969-4038-8f3a-fcfe6ec7b4f8 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:32:45.480806 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-3792072c-6969-4038-8f3a-fcfe6ec7b4f8 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] 10.222.0.46 "GET /compute/v2.1/servers/2e3bce83-6dff-479d-a54c-8f660fbbcdc5" status: 200 len: 1722 microversion: 2.20 time: 0.199171 Aug 04 05:32:45.481837 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 404/813] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Aug 4 05:32:45 2022] GET /compute/v2.1/servers/2e3bce83-6dff-479d-a54c-8f660fbbcdc5 => generated 1722 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 05:32:45.571585 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [req-7454c7cf-bc39-4d17-a010-acda9dc87935 req-b11fead9-15de-4425-8131-6f92e0c38bcd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e3bce83-6dff-479d-a54c-8f660fbbcdc5", "name": "network-vif-unplugged", "status": "completed", "tag": "ddeaefd6-9468-4764-8ef0-df45fd5ea8db"}]} {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:32:45.581774 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [req-7454c7cf-bc39-4d17-a010-acda9dc87935 req-b11fead9-15de-4425-8131-6f92e0c38bcd service nova] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:32:45.585595 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [req-7454c7cf-bc39-4d17-a010-acda9dc87935 req-b11fead9-15de-4425-8131-6f92e0c38bcd service nova] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:32:45.593464 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.compute.server_external_events [req-7454c7cf-bc39-4d17-a010-acda9dc87935 req-b11fead9-15de-4425-8131-6f92e0c38bcd service nova] Creating event network-vif-unplugged:ddeaefd6-9468-4764-8ef0-df45fd5ea8db for instance 2e3bce83-6dff-479d-a54c-8f660fbbcdc5 on hv-cinder-85207 Aug 04 05:32:45.599249 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [req-7454c7cf-bc39-4d17-a010-acda9dc87935 req-b11fead9-15de-4425-8131-6f92e0c38bcd service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031341 Aug 04 05:32:45.599880 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 410/814] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Aug 4 05:32:45 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:32:46.096976 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-59758fff-0019-42dd-925a-0e109141010a tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:32:46.097759 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-59758fff-0019-42dd-925a-0e109141010a tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] [instance: 8558ff08-5004-4dc4-892d-5b6610ce6bec] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:32:46.103831 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-59758fff-0019-42dd-925a-0e109141010a tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:32:46.104284 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-59758fff-0019-42dd-925a-0e109141010a tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:32:46.105056 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-59758fff-0019-42dd-925a-0e109141010a tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:32:46.105497 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-59758fff-0019-42dd-925a-0e109141010a tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:32:46.136018 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-59758fff-0019-42dd-925a-0e109141010a tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:32:46.136473 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-59758fff-0019-42dd-925a-0e109141010a tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:32:46.136926 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.objects.instance [None req-59758fff-0019-42dd-925a-0e109141010a tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Lazy-loading 'fault' on Instance uuid 8558ff08-5004-4dc4-892d-5b6610ce6bec {{(pid=118476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 05:32:46.183561 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-59758fff-0019-42dd-925a-0e109141010a tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965cf2aad5bc4def9fca55aac87cc37e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32569df1dca45cebcdd63d03ff5abae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:32:46.192117 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-59758fff-0019-42dd-925a-0e109141010a tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] 10.222.0.46 "GET /compute/v2.1/servers/8558ff08-5004-4dc4-892d-5b6610ce6bec" status: 200 len: 1224 microversion: 2.1 time: 0.098906 Aug 04 05:32:46.192703 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 405/815] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:32:46 2022] GET /compute/v2.1/servers/8558ff08-5004-4dc4-892d-5b6610ce6bec => generated 1224 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:32:46.507768 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-d3e1a240-58a0-469d-b6fa-5315f609e76c tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:32:46.508474 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-d3e1a240-58a0-469d-b6fa-5315f609e76c tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] [instance: 2e3bce83-6dff-479d-a54c-8f660fbbcdc5] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:32:46.514863 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-d3e1a240-58a0-469d-b6fa-5315f609e76c tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:32:46.515309 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-d3e1a240-58a0-469d-b6fa-5315f609e76c tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:32:46.516077 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-d3e1a240-58a0-469d-b6fa-5315f609e76c tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:32:46.516510 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-d3e1a240-58a0-469d-b6fa-5315f609e76c tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:32:46.698276 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-d3e1a240-58a0-469d-b6fa-5315f609e76c tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:32:46.706506 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-d3e1a240-58a0-469d-b6fa-5315f609e76c tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:32:46.708044 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-d3e1a240-58a0-469d-b6fa-5315f609e76c tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:32:46.709470 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-d3e1a240-58a0-469d-b6fa-5315f609e76c tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] 10.222.0.46 "GET /compute/v2.1/servers/2e3bce83-6dff-479d-a54c-8f660fbbcdc5" status: 200 len: 1725 microversion: 2.20 time: 0.206811 Aug 04 05:32:46.710033 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 411/816] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Aug 4 05:32:46 2022] GET /compute/v2.1/servers/2e3bce83-6dff-479d-a54c-8f660fbbcdc5 => generated 1725 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 05:32:46.732859 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-5bd28005-328d-4669-8587-4c20d7cc151b tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0e80b2ba-e41d-47dc-9c57-ea80a9fe6cf2"}} {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:32:46.735130 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-5bd28005-328d-4669-8587-4c20d7cc151b tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] [instance: 2e3bce83-6dff-479d-a54c-8f660fbbcdc5] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:32:46.742190 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-5bd28005-328d-4669-8587-4c20d7cc151b tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:32:46.742673 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-5bd28005-328d-4669-8587-4c20d7cc151b tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:32:46.743449 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-5bd28005-328d-4669-8587-4c20d7cc151b tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:32:46.743888 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-5bd28005-328d-4669-8587-4c20d7cc151b tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:32:47.212904 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-1e357cfb-a248-446b-b585-ac2c7b9550d8 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:32:47.213523 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-1e357cfb-a248-446b-b585-ac2c7b9550d8 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] [instance: 8558ff08-5004-4dc4-892d-5b6610ce6bec] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:32:47.220780 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-1e357cfb-a248-446b-b585-ac2c7b9550d8 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:32:47.225334 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-1e357cfb-a248-446b-b585-ac2c7b9550d8 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:32:47.225334 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-1e357cfb-a248-446b-b585-ac2c7b9550d8 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:32:47.225334 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-1e357cfb-a248-446b-b585-ac2c7b9550d8 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:32:47.237541 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.wsgi [None req-1e357cfb-a248-446b-b585-ac2c7b9550d8 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] HTTP exception thrown: Instance 8558ff08-5004-4dc4-892d-5b6610ce6bec could not be found. Aug 04 05:32:47.239283 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-1e357cfb-a248-446b-b585-ac2c7b9550d8 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Request method failure captured: Aug 04 05:32:47.239283 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: request: GET /compute/v2.1/servers/8558ff08-5004-4dc4-892d-5b6610ce6bec HTTP/1.1 Aug 04 05:32:47.239283 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: Accept: application/json Aug 04 05:32:47.239283 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: Accept-Encoding: identity Aug 04 05:32:47.239283 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: Connection: close Aug 04 05:32:47.239283 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: Content-Length: 0 Aug 04 05:32:47.239283 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: Content-Type: application/json Aug 04 05:32:47.239283 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: Host: 10.222.0.46 Aug 04 05:32:47.239283 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: Openstack-System-Scope: None Aug 04 05:32:47.239283 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: User-Agent: python-urllib3/1.26.11 Aug 04 05:32:47.239283 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Auth-Token: gAAAAABi61ihdrVwWYWftHfmNyJ7dnfBzfS1-4O82Y17O_BhMNUCohGbbGjkI1Cw0Abod7-6PtK2gzgOMERCpqk-pXf42jQA7UvSu1gDDZR1fb8GoAOMzFEQQeKbyWKDU6WK5zwmgaq-wUvt7_SPj1lbYe5XuuR4pSqLZImxao0hA3ij7j1E600 Aug 04 05:32:47.239283 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Domain-Id: None Aug 04 05:32:47.239283 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Domain-Name: None Aug 04 05:32:47.239283 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Identity-Status: Confirmed Aug 04 05:32:47.239283 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Is-Admin-Project: True Aug 04 05:32:47.239283 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Project-Domain-Id: default Aug 04 05:32:47.239283 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Project-Domain-Name: Default Aug 04 05:32:47.239283 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Project-Id: e32569df1dca45cebcdd63d03ff5abae Aug 04 05:32:47.239283 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Project-Name: tempest-TestShelveInstance-1792475113 Aug 04 05:32:47.239283 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Role: member,reader Aug 04 05:32:47.239283 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Roles: member,reader Aug 04 05:32:47.240771 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/e32569df1dca45cebcdd63d03ff5abae"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/e32569df1dca45cebcdd63d03ff5abae"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_e32569df1dca45cebcdd63d03ff5abae", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/e32569df1dca45cebcdd63d03ff5abae"}]}] Aug 04 05:32:47.240771 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Tenant: tempest-TestShelveInstance-1792475113 Aug 04 05:32:47.240771 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Tenant-Id: e32569df1dca45cebcdd63d03ff5abae Aug 04 05:32:47.240771 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Tenant-Name: tempest-TestShelveInstance-1792475113 Aug 04 05:32:47.240771 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-User: tempest-TestShelveInstance-1792475113-project Aug 04 05:32:47.240771 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-User-Domain-Id: default Aug 04 05:32:47.240771 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-User-Domain-Name: Default Aug 04 05:32:47.240771 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-User-Id: 965cf2aad5bc4def9fca55aac87cc37e Aug 04 05:32:47.240771 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-User-Name: tempest-TestShelveInstance-1792475113-project Aug 04 05:32:47.240771 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: method: > Aug 04 05:32:47.240771 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: exception: Instance 8558ff08-5004-4dc4-892d-5b6610ce6bec could not be found. Aug 04 05:32:47.240771 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: action_args: {'id': '8558ff08-5004-4dc4-892d-5b6610ce6bec'} Aug 04 05:32:47.241671 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 05:32:47.241671 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:32:47.241671 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 05:32:47.241671 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 05:32:47.241671 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 05:32:47.241671 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 05:32:47.241671 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 05:32:47.241671 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 05:32:47.241671 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 05:32:47.241671 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 05:32:47.241671 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8558ff08-5004-4dc4-892d-5b6610ce6bec could not be found. Aug 04 05:32:47.241671 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Aug 04 05:32:47.241671 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:32:47.241671 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Aug 04 05:32:47.241671 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:32:47.241671 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:32:47.241671 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:32:47.241671 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 05:32:47.241671 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 05:32:47.241671 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 05:32:47.243104 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 05:32:47.243104 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 05:32:47.243104 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 05:32:47.243104 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 05:32:47.243104 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 05:32:47.243104 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 05:32:47.243104 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 05:32:47.243104 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8558ff08-5004-4dc4-892d-5b6610ce6bec could not be found. Aug 04 05:32:47.243104 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Aug 04 05:32:47.243104 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:32:47.243104 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Aug 04 05:32:47.243104 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:32:47.243104 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:32:47.243104 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:32:47.243104 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 05:32:47.243104 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 05:32:47.243104 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8558ff08-5004-4dc4-892d-5b6610ce6bec could not be found. Aug 04 05:32:47.243104 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Aug 04 05:32:47.244442 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-1e357cfb-a248-446b-b585-ac2c7b9550d8 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Returning 404 to user: Instance 8558ff08-5004-4dc4-892d-5b6610ce6bec could not be found. {{(pid=118477) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 05:32:47.244442 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-1e357cfb-a248-446b-b585-ac2c7b9550d8 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] 10.222.0.46 "GET /compute/v2.1/servers/8558ff08-5004-4dc4-892d-5b6610ce6bec" status: 404 len: 111 microversion: 2.1 time: 0.031639 Aug 04 05:32:47.244442 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 412/817] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:32:47 2022] GET /compute/v2.1/servers/8558ff08-5004-4dc4-892d-5b6610ce6bec => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 04 05:32:47.487916 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-ef804658-3305-41dc-b018-569f33868d67 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] Calling method '.version_select at 0x7f14754705e0>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:32:47.581754 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-ef804658-3305-41dc-b018-569f33868d67 tempest-TestShelveInstance-1792475113 tempest-TestShelveInstance-1792475113-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-564503341" status: 202 len: 0 microversion: 2.1 time: 0.099097 Aug 04 05:32:47.584471 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 413/818] 10.222.0.46 () {58 vars in 1251 bytes} [Thu Aug 4 05:32:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-564503341 => generated 0 bytes in 103 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 04 05:32:47.598053 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-0681bb50-86a5-4658-982d-eccfd2085203 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:32:47.598053 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-0681bb50-86a5-4658-982d-eccfd2085203 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] [instance: 938a0d12-9045-4220-b0ee-a4ed0a3c4b6a] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:32:47.598053 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-0681bb50-86a5-4658-982d-eccfd2085203 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:32:47.601605 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-0681bb50-86a5-4658-982d-eccfd2085203 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:32:47.601605 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-0681bb50-86a5-4658-982d-eccfd2085203 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:32:47.601605 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-0681bb50-86a5-4658-982d-eccfd2085203 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:32:47.618145 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.wsgi [None req-0681bb50-86a5-4658-982d-eccfd2085203 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] HTTP exception thrown: Instance 938a0d12-9045-4220-b0ee-a4ed0a3c4b6a could not be found. Aug 04 05:32:47.620224 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-0681bb50-86a5-4658-982d-eccfd2085203 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Request method failure captured: Aug 04 05:32:47.620224 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: request: DELETE /compute/v2.1/servers/938a0d12-9045-4220-b0ee-a4ed0a3c4b6a HTTP/1.1 Aug 04 05:32:47.620224 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: Accept: application/json Aug 04 05:32:47.620224 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: Accept-Encoding: identity Aug 04 05:32:47.620224 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: Connection: close Aug 04 05:32:47.620224 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: Content-Length: 0 Aug 04 05:32:47.620224 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: Content-Type: application/json Aug 04 05:32:47.620224 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: Host: 10.222.0.46 Aug 04 05:32:47.620224 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: Openstack-System-Scope: None Aug 04 05:32:47.620224 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: User-Agent: python-urllib3/1.26.11 Aug 04 05:32:47.620224 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Auth-Token: gAAAAABi61ibB27zcAqkTFBz3ZHZQBTyYLUiz1L71kTAJ1mIgw23NzfP3be8JfDUo2j8H621Gq4ZtR6Qkl_uc57pKHyYmWoyApQ0u1rcdhH843jVllSfSpyjvEna5qAHPkZneB2RW8yXCDwaidRZA-fexzYeio0C9gcFg53_Z47USjhBWgHa8uc Aug 04 05:32:47.620224 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Domain-Id: None Aug 04 05:32:47.620224 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Domain-Name: None Aug 04 05:32:47.620224 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Identity-Status: Confirmed Aug 04 05:32:47.620224 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Is-Admin-Project: True Aug 04 05:32:47.620224 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Project-Domain-Id: default Aug 04 05:32:47.620224 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Project-Domain-Name: Default Aug 04 05:32:47.620224 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Project-Id: d1ca4b83dc874bda9f33e06f4910608c Aug 04 05:32:47.620224 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Project-Name: tempest-AttachVolumeTestJSON-785443369 Aug 04 05:32:47.620224 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Role: member,reader Aug 04 05:32:47.620224 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Roles: member,reader Aug 04 05:32:47.621871 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/d1ca4b83dc874bda9f33e06f4910608c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/d1ca4b83dc874bda9f33e06f4910608c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_d1ca4b83dc874bda9f33e06f4910608c", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/d1ca4b83dc874bda9f33e06f4910608c"}]}] Aug 04 05:32:47.621871 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Tenant: tempest-AttachVolumeTestJSON-785443369 Aug 04 05:32:47.621871 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Tenant-Id: d1ca4b83dc874bda9f33e06f4910608c Aug 04 05:32:47.621871 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Tenant-Name: tempest-AttachVolumeTestJSON-785443369 Aug 04 05:32:47.621871 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-User: tempest-AttachVolumeTestJSON-785443369-project Aug 04 05:32:47.621871 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-User-Domain-Id: default Aug 04 05:32:47.621871 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-User-Domain-Name: Default Aug 04 05:32:47.621871 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-User-Id: eb4dea95659c473b9b193c6234186430 Aug 04 05:32:47.621871 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-User-Name: tempest-AttachVolumeTestJSON-785443369-project Aug 04 05:32:47.621871 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: method: > Aug 04 05:32:47.621871 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: exception: Instance 938a0d12-9045-4220-b0ee-a4ed0a3c4b6a could not be found. Aug 04 05:32:47.621871 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: action_args: {'id': '938a0d12-9045-4220-b0ee-a4ed0a3c4b6a'} Aug 04 05:32:47.622887 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 05:32:47.622887 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:32:47.622887 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 05:32:47.622887 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 05:32:47.622887 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 05:32:47.622887 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 05:32:47.622887 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 05:32:47.622887 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 05:32:47.622887 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 05:32:47.622887 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 05:32:47.622887 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 938a0d12-9045-4220-b0ee-a4ed0a3c4b6a could not be found. Aug 04 05:32:47.622887 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Aug 04 05:32:47.622887 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:32:47.622887 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Aug 04 05:32:47.622887 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:32:47.622887 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:32:47.622887 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:32:47.622887 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 05:32:47.622887 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 05:32:47.622887 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 05:32:47.624329 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 05:32:47.624329 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 05:32:47.624329 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 05:32:47.624329 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 05:32:47.624329 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 05:32:47.624329 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 05:32:47.624329 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 05:32:47.624329 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 05:32:47.624329 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 05:32:47.624329 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 938a0d12-9045-4220-b0ee-a4ed0a3c4b6a could not be found. Aug 04 05:32:47.624329 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Aug 04 05:32:47.624329 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:32:47.624329 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Aug 04 05:32:47.624329 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:32:47.624329 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:32:47.624329 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:32:47.624329 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 05:32:47.624329 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 05:32:47.624329 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 938a0d12-9045-4220-b0ee-a4ed0a3c4b6a could not be found. Aug 04 05:32:47.624329 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Aug 04 05:32:47.626800 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-0681bb50-86a5-4658-982d-eccfd2085203 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Returning 404 to user: Instance 938a0d12-9045-4220-b0ee-a4ed0a3c4b6a could not be found. {{(pid=118477) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 05:32:47.634980 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-0681bb50-86a5-4658-982d-eccfd2085203 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] 10.222.0.46 "DELETE /compute/v2.1/servers/938a0d12-9045-4220-b0ee-a4ed0a3c4b6a" status: 404 len: 111 microversion: 2.1 time: 0.042381 Aug 04 05:32:47.634980 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 414/819] 10.222.0.46 () {58 vars in 1239 bytes} [Thu Aug 4 05:32:47 2022] DELETE /compute/v2.1/servers/938a0d12-9045-4220-b0ee-a4ed0a3c4b6a => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 05:32:47.643963 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-dc6fd604-e387-42cc-abdc-4b6b98e9429c tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:32:47.645197 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-dc6fd604-e387-42cc-abdc-4b6b98e9429c tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] [instance: 938a0d12-9045-4220-b0ee-a4ed0a3c4b6a] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:32:47.652253 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-dc6fd604-e387-42cc-abdc-4b6b98e9429c tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:32:47.652702 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-dc6fd604-e387-42cc-abdc-4b6b98e9429c tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:32:47.653743 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-dc6fd604-e387-42cc-abdc-4b6b98e9429c tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:32:47.654181 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-dc6fd604-e387-42cc-abdc-4b6b98e9429c tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:32:47.669513 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.wsgi [None req-dc6fd604-e387-42cc-abdc-4b6b98e9429c tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] HTTP exception thrown: Instance 938a0d12-9045-4220-b0ee-a4ed0a3c4b6a could not be found. Aug 04 05:32:47.671086 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-dc6fd604-e387-42cc-abdc-4b6b98e9429c tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Request method failure captured: Aug 04 05:32:47.671086 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: request: GET /compute/v2.1/servers/938a0d12-9045-4220-b0ee-a4ed0a3c4b6a HTTP/1.1 Aug 04 05:32:47.671086 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: Accept: application/json Aug 04 05:32:47.671086 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: Accept-Encoding: identity Aug 04 05:32:47.671086 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: Connection: close Aug 04 05:32:47.671086 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: Content-Length: 0 Aug 04 05:32:47.671086 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: Content-Type: application/json Aug 04 05:32:47.671086 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: Host: 10.222.0.46 Aug 04 05:32:47.671086 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: Openstack-System-Scope: None Aug 04 05:32:47.671086 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: User-Agent: python-urllib3/1.26.11 Aug 04 05:32:47.671086 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Auth-Token: gAAAAABi61ibB27zcAqkTFBz3ZHZQBTyYLUiz1L71kTAJ1mIgw23NzfP3be8JfDUo2j8H621Gq4ZtR6Qkl_uc57pKHyYmWoyApQ0u1rcdhH843jVllSfSpyjvEna5qAHPkZneB2RW8yXCDwaidRZA-fexzYeio0C9gcFg53_Z47USjhBWgHa8uc Aug 04 05:32:47.671086 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Domain-Id: None Aug 04 05:32:47.671086 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Domain-Name: None Aug 04 05:32:47.671086 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Identity-Status: Confirmed Aug 04 05:32:47.671086 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Is-Admin-Project: True Aug 04 05:32:47.671086 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Project-Domain-Id: default Aug 04 05:32:47.671086 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Project-Domain-Name: Default Aug 04 05:32:47.671086 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Project-Id: d1ca4b83dc874bda9f33e06f4910608c Aug 04 05:32:47.671086 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Project-Name: tempest-AttachVolumeTestJSON-785443369 Aug 04 05:32:47.671086 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Role: member,reader Aug 04 05:32:47.671086 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Roles: member,reader Aug 04 05:32:47.672675 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/d1ca4b83dc874bda9f33e06f4910608c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/d1ca4b83dc874bda9f33e06f4910608c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_d1ca4b83dc874bda9f33e06f4910608c", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/d1ca4b83dc874bda9f33e06f4910608c"}]}] Aug 04 05:32:47.672675 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Tenant: tempest-AttachVolumeTestJSON-785443369 Aug 04 05:32:47.672675 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Tenant-Id: d1ca4b83dc874bda9f33e06f4910608c Aug 04 05:32:47.672675 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Tenant-Name: tempest-AttachVolumeTestJSON-785443369 Aug 04 05:32:47.672675 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-User: tempest-AttachVolumeTestJSON-785443369-project Aug 04 05:32:47.672675 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-User-Domain-Id: default Aug 04 05:32:47.672675 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-User-Domain-Name: Default Aug 04 05:32:47.672675 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-User-Id: eb4dea95659c473b9b193c6234186430 Aug 04 05:32:47.672675 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-User-Name: tempest-AttachVolumeTestJSON-785443369-project Aug 04 05:32:47.672675 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: method: > Aug 04 05:32:47.672675 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: exception: Instance 938a0d12-9045-4220-b0ee-a4ed0a3c4b6a could not be found. Aug 04 05:32:47.672675 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: action_args: {'id': '938a0d12-9045-4220-b0ee-a4ed0a3c4b6a'} Aug 04 05:32:47.674597 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 05:32:47.674597 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:32:47.674597 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 05:32:47.674597 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 05:32:47.674597 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 05:32:47.674597 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 05:32:47.674597 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 05:32:47.674597 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 05:32:47.674597 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 05:32:47.674597 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 05:32:47.674597 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 938a0d12-9045-4220-b0ee-a4ed0a3c4b6a could not be found. Aug 04 05:32:47.674597 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Aug 04 05:32:47.674597 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:32:47.674597 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Aug 04 05:32:47.674597 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:32:47.674597 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:32:47.674597 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:32:47.674597 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 05:32:47.674597 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 05:32:47.674597 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 05:32:47.676152 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 05:32:47.676152 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 05:32:47.676152 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 05:32:47.676152 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 05:32:47.676152 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 05:32:47.676152 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 05:32:47.676152 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 05:32:47.676152 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 938a0d12-9045-4220-b0ee-a4ed0a3c4b6a could not be found. Aug 04 05:32:47.676152 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Aug 04 05:32:47.676152 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:32:47.676152 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Aug 04 05:32:47.676152 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:32:47.676152 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:32:47.676152 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:32:47.676152 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 05:32:47.676152 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 05:32:47.676152 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 938a0d12-9045-4220-b0ee-a4ed0a3c4b6a could not be found. Aug 04 05:32:47.676152 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Aug 04 05:32:47.677423 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-dc6fd604-e387-42cc-abdc-4b6b98e9429c tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Returning 404 to user: Instance 938a0d12-9045-4220-b0ee-a4ed0a3c4b6a could not be found. {{(pid=118477) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 05:32:47.677423 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-dc6fd604-e387-42cc-abdc-4b6b98e9429c tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] 10.222.0.46 "GET /compute/v2.1/servers/938a0d12-9045-4220-b0ee-a4ed0a3c4b6a" status: 404 len: 111 microversion: 2.1 time: 0.034211 Aug 04 05:32:47.677423 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 415/820] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:32:47 2022] GET /compute/v2.1/servers/938a0d12-9045-4220-b0ee-a4ed0a3c4b6a => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 05:32:47.863909 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-92796b25-a94e-406a-8ccc-964072319e72 tempest-VolumesNegativeTest-592855343 tempest-VolumesNegativeTest-592855343-project] Action: 'create', calling method: .version_select at 0x7f14758610d0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-338303390", "metadata": {"Type": "work"}}} {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:32:47.883593 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-92796b25-a94e-406a-8ccc-964072319e72 tempest-VolumesNegativeTest-592855343 tempest-VolumesNegativeTest-592855343-project] Request method failure captured: Aug 04 05:32:47.883593 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 04 05:32:47.883593 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: Accept: application/json Aug 04 05:32:47.883593 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: Accept-Encoding: identity Aug 04 05:32:47.883593 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: Connection: close Aug 04 05:32:47.883593 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: Content-Length: 121 Aug 04 05:32:47.883593 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: Content-Type: application/json Aug 04 05:32:47.883593 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: Host: 10.222.0.46 Aug 04 05:32:47.883593 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: Openstack-System-Scope: None Aug 04 05:32:47.883593 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: User-Agent: python-urllib3/1.26.11 Aug 04 05:32:47.883593 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Auth-Token: gAAAAABi61n_LghiVAzW7CKc66_zhhsmb7hEySJzbO0rEtlRY0yI22A5HFEZoYJeyTmYnZsMw2qiw1dH5bmzYK8QYAdNZdDE3nezBs3cyvM9Ak1ZAy10nqXXt1uCjX81_FV7VyeXMfTzjKQG2DC102bKd8EOsoLkUjA10qAvctVLuuxUpp3AjnQ Aug 04 05:32:47.883593 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Domain-Id: None Aug 04 05:32:47.883593 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Domain-Name: None Aug 04 05:32:47.883593 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Identity-Status: Confirmed Aug 04 05:32:47.883593 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Is-Admin-Project: True Aug 04 05:32:47.883593 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Project-Domain-Id: default Aug 04 05:32:47.883593 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Project-Domain-Name: Default Aug 04 05:32:47.883593 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Project-Id: a89ad700f80542beb03f216e9e51b6c4 Aug 04 05:32:47.883593 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Project-Name: tempest-VolumesNegativeTest-592855343 Aug 04 05:32:47.883593 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Role: member,reader Aug 04 05:32:47.883593 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Roles: member,reader Aug 04 05:32:47.885269 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/a89ad700f80542beb03f216e9e51b6c4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/a89ad700f80542beb03f216e9e51b6c4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_a89ad700f80542beb03f216e9e51b6c4", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/a89ad700f80542beb03f216e9e51b6c4"}]}] Aug 04 05:32:47.885269 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Tenant: tempest-VolumesNegativeTest-592855343 Aug 04 05:32:47.885269 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Tenant-Id: a89ad700f80542beb03f216e9e51b6c4 Aug 04 05:32:47.885269 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Tenant-Name: tempest-VolumesNegativeTest-592855343 Aug 04 05:32:47.885269 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-User: tempest-VolumesNegativeTest-592855343-project Aug 04 05:32:47.885269 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-User-Domain-Id: default Aug 04 05:32:47.885269 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-User-Domain-Name: Default Aug 04 05:32:47.885269 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-User-Id: 9645255aa18b44a3952008e812b34360 Aug 04 05:32:47.885269 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-User-Name: tempest-VolumesNegativeTest-592855343-project Aug 04 05:32:47.885269 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: Aug 04 05:32:47.885269 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-338303390", "metadata": {"Type": "work"}}} Aug 04 05:32:47.885269 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: method: Aug 04 05:32:47.885269 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 04 05:32:47.886272 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-338303390', 'metadata': {'Type': 'work'}}}} Aug 04 05:32:47.886272 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 05:32:47.886272 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:32:47.886272 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 04 05:32:47.886272 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 04 05:32:47.886272 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 04 05:32:47.886272 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi raise error Aug 04 05:32:47.886272 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Aug 04 05:32:47.886272 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Aug 04 05:32:47.886272 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 04 05:32:47.886272 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 04 05:32:47.886272 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Aug 04 05:32:47.886272 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 04 05:32:47.886272 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi '#$%' Aug 04 05:32:47.886272 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Aug 04 05:32:47.886272 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:32:47.886272 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Aug 04 05:32:47.886272 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:32:47.886272 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:32:47.886272 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:32:47.886272 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 05:32:47.886272 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 05:32:47.887967 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 05:32:47.887967 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 05:32:47.887967 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 05:32:47.887967 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 05:32:47.887967 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 04 05:32:47.887967 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 04 05:32:47.887967 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 04 05:32:47.887967 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 04 05:32:47.887967 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 04 05:32:47.887967 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 04 05:32:47.887967 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 04 05:32:47.887967 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Aug 04 05:32:47.887967 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:32:47.887967 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Aug 04 05:32:47.887967 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:32:47.887967 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:32:47.887967 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:32:47.887967 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 04 05:32:47.887967 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 04 05:32:47.889344 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 04 05:32:47.889344 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Aug 04 05:32:47.894198 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-5bd28005-328d-4669-8587-4c20d7cc151b tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] 10.222.0.46 "POST /compute/v2.1/servers/2e3bce83-6dff-479d-a54c-8f660fbbcdc5/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.165444 Aug 04 05:32:47.896317 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 406/821] 10.222.0.46 () {62 vars in 1364 bytes} [Thu Aug 4 05:32:46 2022] POST /compute/v2.1/servers/2e3bce83-6dff-479d-a54c-8f660fbbcdc5/os-volume_attachments => generated 188 bytes in 1168 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 05:32:47.899192 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-92796b25-a94e-406a-8ccc-964072319e72 tempest-VolumesNegativeTest-592855343 tempest-VolumesNegativeTest-592855343-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=118477) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 05:32:47.901642 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-92796b25-a94e-406a-8ccc-964072319e72 tempest-VolumesNegativeTest-592855343 tempest-VolumesNegativeTest-592855343-project] 10.222.0.46 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.161942 Aug 04 05:32:47.903737 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 416/822] 10.222.0.46 () {60 vars in 1156 bytes} [Thu Aug 4 05:32:47 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 165 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 04 05:32:47.913490 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-51692a5d-41c9-44d8-ac62-9a1cef9fccf6 tempest-VolumesNegativeTest-592855343 tempest-VolumesNegativeTest-592855343-project] Action: 'create', calling method: .version_select at 0x7f1475408d30>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1668636368", "metadata": {"Type": "work"}}} {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:32:47.918635 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-51692a5d-41c9-44d8-ac62-9a1cef9fccf6 tempest-VolumesNegativeTest-592855343 tempest-VolumesNegativeTest-592855343-project] Request method failure captured: Aug 04 05:32:47.918635 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 04 05:32:47.918635 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: Accept: application/json Aug 04 05:32:47.918635 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: Accept-Encoding: identity Aug 04 05:32:47.918635 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: Connection: close Aug 04 05:32:47.918635 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: Content-Length: 120 Aug 04 05:32:47.918635 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: Content-Type: application/json Aug 04 05:32:47.918635 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: Host: 10.222.0.46 Aug 04 05:32:47.918635 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: Openstack-System-Scope: None Aug 04 05:32:47.918635 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: User-Agent: python-urllib3/1.26.11 Aug 04 05:32:47.918635 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Auth-Token: gAAAAABi61n_LghiVAzW7CKc66_zhhsmb7hEySJzbO0rEtlRY0yI22A5HFEZoYJeyTmYnZsMw2qiw1dH5bmzYK8QYAdNZdDE3nezBs3cyvM9Ak1ZAy10nqXXt1uCjX81_FV7VyeXMfTzjKQG2DC102bKd8EOsoLkUjA10qAvctVLuuxUpp3AjnQ Aug 04 05:32:47.918635 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Domain-Id: None Aug 04 05:32:47.918635 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Domain-Name: None Aug 04 05:32:47.918635 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Identity-Status: Confirmed Aug 04 05:32:47.918635 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Is-Admin-Project: True Aug 04 05:32:47.918635 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Project-Domain-Id: default Aug 04 05:32:47.918635 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Project-Domain-Name: Default Aug 04 05:32:47.918635 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Project-Id: a89ad700f80542beb03f216e9e51b6c4 Aug 04 05:32:47.918635 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Project-Name: tempest-VolumesNegativeTest-592855343 Aug 04 05:32:47.918635 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Role: member,reader Aug 04 05:32:47.918635 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Roles: member,reader Aug 04 05:32:47.920207 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/a89ad700f80542beb03f216e9e51b6c4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/a89ad700f80542beb03f216e9e51b6c4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_a89ad700f80542beb03f216e9e51b6c4", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/a89ad700f80542beb03f216e9e51b6c4"}]}] Aug 04 05:32:47.920207 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Tenant: tempest-VolumesNegativeTest-592855343 Aug 04 05:32:47.920207 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Tenant-Id: a89ad700f80542beb03f216e9e51b6c4 Aug 04 05:32:47.920207 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Tenant-Name: tempest-VolumesNegativeTest-592855343 Aug 04 05:32:47.920207 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-User: tempest-VolumesNegativeTest-592855343-project Aug 04 05:32:47.920207 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-User-Domain-Id: default Aug 04 05:32:47.920207 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-User-Domain-Name: Default Aug 04 05:32:47.920207 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-User-Id: 9645255aa18b44a3952008e812b34360 Aug 04 05:32:47.920207 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-User-Name: tempest-VolumesNegativeTest-592855343-project Aug 04 05:32:47.920207 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: Aug 04 05:32:47.920207 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1668636368", "metadata": {"Type": "work"}}} Aug 04 05:32:47.920207 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: method: Aug 04 05:32:47.920207 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 04 05:32:47.921186 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1668636368', 'metadata': {'Type': 'work'}}}} Aug 04 05:32:47.921186 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 05:32:47.921186 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:32:47.921186 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 04 05:32:47.921186 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 04 05:32:47.921186 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 04 05:32:47.921186 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi raise error Aug 04 05:32:47.921186 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 04 05:32:47.921186 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Aug 04 05:32:47.921186 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Aug 04 05:32:47.921186 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 04 05:32:47.921186 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Aug 04 05:32:47.921186 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 04 05:32:47.921186 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi '0' Aug 04 05:32:47.921186 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Aug 04 05:32:47.921186 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:32:47.921186 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Aug 04 05:32:47.921186 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:32:47.921186 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:32:47.921186 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:32:47.921186 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 05:32:47.921186 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 05:32:47.925672 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 05:32:47.925672 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 05:32:47.925672 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 05:32:47.925672 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 05:32:47.925672 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 04 05:32:47.925672 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 04 05:32:47.925672 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 04 05:32:47.925672 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 04 05:32:47.925672 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 04 05:32:47.925672 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 04 05:32:47.925672 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 04 05:32:47.925672 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Aug 04 05:32:47.925672 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:32:47.925672 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Aug 04 05:32:47.925672 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:32:47.925672 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:32:47.925672 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:32:47.925672 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 04 05:32:47.925672 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 04 05:32:47.927101 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 04 05:32:47.927101 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Aug 04 05:32:47.927101 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-51692a5d-41c9-44d8-ac62-9a1cef9fccf6 tempest-VolumesNegativeTest-592855343 tempest-VolumesNegativeTest-592855343-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=118476) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 05:32:47.927492 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-51692a5d-41c9-44d8-ac62-9a1cef9fccf6 tempest-VolumesNegativeTest-592855343 tempest-VolumesNegativeTest-592855343-project] 10.222.0.46 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.015991 Aug 04 05:32:47.932638 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 407/823] 10.222.0.46 () {60 vars in 1156 bytes} [Thu Aug 4 05:32:47 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 24 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 04 05:32:47.938178 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-6a250f01-096e-4c7b-a54d-2783924a24d4 tempest-VolumesNegativeTest-592855343 tempest-VolumesNegativeTest-592855343-project] Action: 'create', calling method: .version_select at 0x7f147547a670>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1329646206", "metadata": {"Type": "work"}}} {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:32:47.943533 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-6a250f01-096e-4c7b-a54d-2783924a24d4 tempest-VolumesNegativeTest-592855343 tempest-VolumesNegativeTest-592855343-project] Request method failure captured: Aug 04 05:32:47.943533 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 04 05:32:47.943533 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: Accept: application/json Aug 04 05:32:47.943533 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: Accept-Encoding: identity Aug 04 05:32:47.943533 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: Connection: close Aug 04 05:32:47.943533 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: Content-Length: 119 Aug 04 05:32:47.943533 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: Content-Type: application/json Aug 04 05:32:47.943533 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: Host: 10.222.0.46 Aug 04 05:32:47.943533 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: Openstack-System-Scope: None Aug 04 05:32:47.943533 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: User-Agent: python-urllib3/1.26.11 Aug 04 05:32:47.943533 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Auth-Token: gAAAAABi61n_LghiVAzW7CKc66_zhhsmb7hEySJzbO0rEtlRY0yI22A5HFEZoYJeyTmYnZsMw2qiw1dH5bmzYK8QYAdNZdDE3nezBs3cyvM9Ak1ZAy10nqXXt1uCjX81_FV7VyeXMfTzjKQG2DC102bKd8EOsoLkUjA10qAvctVLuuxUpp3AjnQ Aug 04 05:32:47.943533 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Domain-Id: None Aug 04 05:32:47.943533 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Domain-Name: None Aug 04 05:32:47.943533 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Identity-Status: Confirmed Aug 04 05:32:47.943533 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Is-Admin-Project: True Aug 04 05:32:47.943533 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Project-Domain-Id: default Aug 04 05:32:47.943533 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Project-Domain-Name: Default Aug 04 05:32:47.943533 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Project-Id: a89ad700f80542beb03f216e9e51b6c4 Aug 04 05:32:47.943533 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Project-Name: tempest-VolumesNegativeTest-592855343 Aug 04 05:32:47.943533 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Role: member,reader Aug 04 05:32:47.943533 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Roles: member,reader Aug 04 05:32:47.944946 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/a89ad700f80542beb03f216e9e51b6c4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/a89ad700f80542beb03f216e9e51b6c4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_a89ad700f80542beb03f216e9e51b6c4", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/a89ad700f80542beb03f216e9e51b6c4"}]}] Aug 04 05:32:47.944946 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Tenant: tempest-VolumesNegativeTest-592855343 Aug 04 05:32:47.944946 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Tenant-Id: a89ad700f80542beb03f216e9e51b6c4 Aug 04 05:32:47.944946 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Tenant-Name: tempest-VolumesNegativeTest-592855343 Aug 04 05:32:47.944946 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-User: tempest-VolumesNegativeTest-592855343-project Aug 04 05:32:47.944946 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-User-Domain-Id: default Aug 04 05:32:47.944946 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-User-Domain-Name: Default Aug 04 05:32:47.944946 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-User-Id: 9645255aa18b44a3952008e812b34360 Aug 04 05:32:47.944946 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-User-Name: tempest-VolumesNegativeTest-592855343-project Aug 04 05:32:47.944946 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: Aug 04 05:32:47.944946 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1329646206", "metadata": {"Type": "work"}}} Aug 04 05:32:47.944946 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: method: Aug 04 05:32:47.944946 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 04 05:32:47.945803 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1329646206', 'metadata': {'Type': 'work'}}}} Aug 04 05:32:47.945803 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 05:32:47.945803 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:32:47.945803 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 04 05:32:47.945803 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 04 05:32:47.945803 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 04 05:32:47.945803 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi raise error Aug 04 05:32:47.945803 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Aug 04 05:32:47.945803 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Aug 04 05:32:47.945803 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 04 05:32:47.945803 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 04 05:32:47.945803 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Aug 04 05:32:47.945803 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 04 05:32:47.945803 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi '' Aug 04 05:32:47.945803 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Aug 04 05:32:47.945803 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:32:47.945803 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Aug 04 05:32:47.945803 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:32:47.945803 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:32:47.945803 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:32:47.945803 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 05:32:47.945803 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 05:32:47.947154 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 05:32:47.947154 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 05:32:47.947154 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 05:32:47.947154 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 05:32:47.947154 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 04 05:32:47.947154 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 04 05:32:47.947154 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 04 05:32:47.947154 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 04 05:32:47.947154 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 04 05:32:47.947154 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 04 05:32:47.947154 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 04 05:32:47.947154 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Aug 04 05:32:47.947154 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:32:47.947154 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Aug 04 05:32:47.947154 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:32:47.947154 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:32:47.947154 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:32:47.947154 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 04 05:32:47.947154 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 04 05:32:47.948287 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 04 05:32:47.948287 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Aug 04 05:32:47.948287 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-6a250f01-096e-4c7b-a54d-2783924a24d4 tempest-VolumesNegativeTest-592855343 tempest-VolumesNegativeTest-592855343-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=118477) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 05:32:47.948287 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-6a250f01-096e-4c7b-a54d-2783924a24d4 tempest-VolumesNegativeTest-592855343 tempest-VolumesNegativeTest-592855343-project] 10.222.0.46 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.011762 Aug 04 05:32:47.948287 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 417/824] 10.222.0.46 () {60 vars in 1156 bytes} [Thu Aug 4 05:32:47 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 13 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 04 05:32:47.957830 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-c907b1a8-9645-47df-86ea-6c7fbb5d95e5 tempest-VolumesNegativeTest-592855343 tempest-VolumesNegativeTest-592855343-project] Calling method '.version_select at 0x7f14754b35e0>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:32:47.991148 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.wsgi [None req-c907b1a8-9645-47df-86ea-6c7fbb5d95e5 tempest-VolumesNegativeTest-592855343 tempest-VolumesNegativeTest-592855343-project] HTTP exception thrown: Volume tempest-invalid-998746874 could not be found. Aug 04 05:32:47.993316 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-c907b1a8-9645-47df-86ea-6c7fbb5d95e5 tempest-VolumesNegativeTest-592855343 tempest-VolumesNegativeTest-592855343-project] Request method failure captured: Aug 04 05:32:47.993316 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-998746874 HTTP/1.1 Aug 04 05:32:47.993316 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: Accept: application/json Aug 04 05:32:47.993316 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: Accept-Encoding: identity Aug 04 05:32:47.993316 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: Connection: close Aug 04 05:32:47.993316 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: Content-Length: 0 Aug 04 05:32:47.993316 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: Content-Type: application/json Aug 04 05:32:47.993316 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: Host: 10.222.0.46 Aug 04 05:32:47.993316 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: Openstack-System-Scope: None Aug 04 05:32:47.993316 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: User-Agent: python-urllib3/1.26.11 Aug 04 05:32:47.993316 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Auth-Token: gAAAAABi61n_LghiVAzW7CKc66_zhhsmb7hEySJzbO0rEtlRY0yI22A5HFEZoYJeyTmYnZsMw2qiw1dH5bmzYK8QYAdNZdDE3nezBs3cyvM9Ak1ZAy10nqXXt1uCjX81_FV7VyeXMfTzjKQG2DC102bKd8EOsoLkUjA10qAvctVLuuxUpp3AjnQ Aug 04 05:32:47.993316 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Domain-Id: None Aug 04 05:32:47.993316 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Domain-Name: None Aug 04 05:32:47.993316 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Identity-Status: Confirmed Aug 04 05:32:47.993316 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Is-Admin-Project: True Aug 04 05:32:47.993316 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Project-Domain-Id: default Aug 04 05:32:47.993316 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Project-Domain-Name: Default Aug 04 05:32:47.993316 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Project-Id: a89ad700f80542beb03f216e9e51b6c4 Aug 04 05:32:47.993316 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Project-Name: tempest-VolumesNegativeTest-592855343 Aug 04 05:32:47.993316 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Role: member,reader Aug 04 05:32:47.993316 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Roles: member,reader Aug 04 05:32:47.994696 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/a89ad700f80542beb03f216e9e51b6c4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/a89ad700f80542beb03f216e9e51b6c4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_a89ad700f80542beb03f216e9e51b6c4", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/a89ad700f80542beb03f216e9e51b6c4"}]}] Aug 04 05:32:47.994696 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Tenant: tempest-VolumesNegativeTest-592855343 Aug 04 05:32:47.994696 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Tenant-Id: a89ad700f80542beb03f216e9e51b6c4 Aug 04 05:32:47.994696 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Tenant-Name: tempest-VolumesNegativeTest-592855343 Aug 04 05:32:47.994696 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-User: tempest-VolumesNegativeTest-592855343-project Aug 04 05:32:47.994696 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-User-Domain-Id: default Aug 04 05:32:47.994696 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-User-Domain-Name: Default Aug 04 05:32:47.994696 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-User-Id: 9645255aa18b44a3952008e812b34360 Aug 04 05:32:47.994696 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-User-Name: tempest-VolumesNegativeTest-592855343-project Aug 04 05:32:47.994696 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: method: Aug 04 05:32:47.994696 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: exception: Volume tempest-invalid-998746874 could not be found. Aug 04 05:32:47.994696 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: action_args: {'id': 'tempest-invalid-998746874'} Aug 04 05:32:47.994696 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 05:32:47.995595 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:32:47.995595 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 04 05:32:47.995595 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 04 05:32:47.995595 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 04 05:32:47.995595 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 04 05:32:47.995595 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 04 05:32:47.995595 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 04 05:32:47.995595 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 04 05:32:47.995595 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 04 05:32:47.995595 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 04 05:32:47.995595 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 04 05:32:47.995595 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 04 05:32:47.995595 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 04 05:32:47.995595 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 04 05:32:47.995595 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 04 05:32:47.995595 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-998746874 could not be found. (HTTP 404) (Request-ID: req-ee5e4bcd-f6f4-46d2-9dc6-15cf91293856) Aug 04 05:32:47.995595 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Aug 04 05:32:47.995595 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:32:47.995595 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Aug 04 05:32:47.996878 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:32:47.996878 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 04 05:32:47.996878 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 04 05:32:47.996878 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 04 05:32:47.996878 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 04 05:32:47.996878 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 04 05:32:47.996878 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 04 05:32:47.996878 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 04 05:32:47.996878 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 04 05:32:47.996878 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 04 05:32:47.996878 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 04 05:32:47.996878 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 04 05:32:47.996878 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 04 05:32:47.996878 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 04 05:32:47.996878 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 04 05:32:47.996878 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 04 05:32:47.996878 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 04 05:32:47.996878 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 04 05:32:47.996878 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 04 05:32:47.998119 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 04 05:32:47.998119 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 04 05:32:47.998119 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 04 05:32:47.998119 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 04 05:32:47.998119 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-998746874 could not be found. Aug 04 05:32:47.998119 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Aug 04 05:32:47.998119 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:32:47.998119 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Aug 04 05:32:47.998119 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:32:47.998119 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:32:47.998119 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:32:47.998119 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 05:32:47.998119 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 05:32:47.998119 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 05:32:47.998119 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 05:32:47.998119 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 05:32:47.998119 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 05:32:47.998119 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 04 05:32:47.998119 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 05:32:47.998119 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-998746874 could not be found. Aug 04 05:32:48.000451 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Aug 04 05:32:48.000451 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:32:48.000451 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Aug 04 05:32:48.000451 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:32:48.000451 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:32:48.000451 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:32:48.000451 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 05:32:48.000451 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 05:32:48.000451 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-998746874 could not be found. Aug 04 05:32:48.000451 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Aug 04 05:32:48.002898 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-c907b1a8-9645-47df-86ea-6c7fbb5d95e5 tempest-VolumesNegativeTest-592855343 tempest-VolumesNegativeTest-592855343-project] Returning 404 to user: Volume tempest-invalid-998746874 could not be found. {{(pid=118476) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 05:32:48.005541 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-c907b1a8-9645-47df-86ea-6c7fbb5d95e5 tempest-VolumesNegativeTest-592855343 tempest-VolumesNegativeTest-592855343-project] 10.222.0.46 "DELETE /compute/v2.1/os-volumes/tempest-invalid-998746874" status: 404 len: 98 microversion: 2.1 time: 0.050631 Aug 04 05:32:48.005541 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 408/825] 10.222.0.46 () {58 vars in 1215 bytes} [Thu Aug 4 05:32:47 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-998746874 => generated 98 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 04 05:32:48.017452 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-7bf81bfa-c56f-4175-b640-c055614bb7a4 tempest-VolumesNegativeTest-592855343 tempest-VolumesNegativeTest-592855343-project] 10.222.0.46 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004514 Aug 04 05:32:48.018645 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 418/826] 10.222.0.46 () {58 vars in 1140 bytes} [Thu Aug 4 05:32:48 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 7 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 04 05:32:48.028661 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-398ce874-4b10-4a3e-9d2d-a45c2b698980 tempest-VolumesNegativeTest-592855343 tempest-VolumesNegativeTest-592855343-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003706 Aug 04 05:32:48.029440 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 409/827] 10.222.0.46 () {58 vars in 1137 bytes} [Thu Aug 4 05:32:48 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 04 05:32:48.043482 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-7a452158-c499-4e56-a7b3-77ffa083f3fe tempest-VolumesNegativeTest-592855343 tempest-VolumesNegativeTest-592855343-project] Calling method '.version_select at 0x7f14754705e0>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:32:48.067272 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-e277e352-f278-4dc7-9d58-c2f90ef12985 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:32:48.067770 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-e277e352-f278-4dc7-9d58-c2f90ef12985 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] [instance: 2e3bce83-6dff-479d-a54c-8f660fbbcdc5] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:32:48.074958 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-e277e352-f278-4dc7-9d58-c2f90ef12985 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:32:48.074958 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-e277e352-f278-4dc7-9d58-c2f90ef12985 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:32:48.076421 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.wsgi [None req-7a452158-c499-4e56-a7b3-77ffa083f3fe tempest-VolumesNegativeTest-592855343 tempest-VolumesNegativeTest-592855343-project] HTTP exception thrown: Volume bdc483d8-0e49-4a30-97b4-2e0c2a0b16ad could not be found. Aug 04 05:32:48.077410 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-e277e352-f278-4dc7-9d58-c2f90ef12985 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:32:48.078044 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-e277e352-f278-4dc7-9d58-c2f90ef12985 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:32:48.078360 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-7a452158-c499-4e56-a7b3-77ffa083f3fe tempest-VolumesNegativeTest-592855343 tempest-VolumesNegativeTest-592855343-project] Request method failure captured: Aug 04 05:32:48.078360 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: request: DELETE /compute/v2.1/os-volumes/bdc483d8-0e49-4a30-97b4-2e0c2a0b16ad HTTP/1.1 Aug 04 05:32:48.078360 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: Accept: application/json Aug 04 05:32:48.078360 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: Accept-Encoding: identity Aug 04 05:32:48.078360 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: Connection: close Aug 04 05:32:48.078360 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: Content-Length: 0 Aug 04 05:32:48.078360 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: Content-Type: application/json Aug 04 05:32:48.078360 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: Host: 10.222.0.46 Aug 04 05:32:48.078360 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: Openstack-System-Scope: None Aug 04 05:32:48.078360 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: User-Agent: python-urllib3/1.26.11 Aug 04 05:32:48.078360 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Auth-Token: gAAAAABi61n_LghiVAzW7CKc66_zhhsmb7hEySJzbO0rEtlRY0yI22A5HFEZoYJeyTmYnZsMw2qiw1dH5bmzYK8QYAdNZdDE3nezBs3cyvM9Ak1ZAy10nqXXt1uCjX81_FV7VyeXMfTzjKQG2DC102bKd8EOsoLkUjA10qAvctVLuuxUpp3AjnQ Aug 04 05:32:48.078360 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Domain-Id: None Aug 04 05:32:48.078360 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Domain-Name: None Aug 04 05:32:48.078360 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Identity-Status: Confirmed Aug 04 05:32:48.078360 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Is-Admin-Project: True Aug 04 05:32:48.078360 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Project-Domain-Id: default Aug 04 05:32:48.078360 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Project-Domain-Name: Default Aug 04 05:32:48.078360 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Project-Id: a89ad700f80542beb03f216e9e51b6c4 Aug 04 05:32:48.078360 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Project-Name: tempest-VolumesNegativeTest-592855343 Aug 04 05:32:48.078360 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Role: member,reader Aug 04 05:32:48.078360 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Roles: member,reader Aug 04 05:32:48.080569 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/a89ad700f80542beb03f216e9e51b6c4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/a89ad700f80542beb03f216e9e51b6c4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_a89ad700f80542beb03f216e9e51b6c4", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/a89ad700f80542beb03f216e9e51b6c4"}]}] Aug 04 05:32:48.080569 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Tenant: tempest-VolumesNegativeTest-592855343 Aug 04 05:32:48.080569 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Tenant-Id: a89ad700f80542beb03f216e9e51b6c4 Aug 04 05:32:48.080569 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Tenant-Name: tempest-VolumesNegativeTest-592855343 Aug 04 05:32:48.080569 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-User: tempest-VolumesNegativeTest-592855343-project Aug 04 05:32:48.080569 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-User-Domain-Id: default Aug 04 05:32:48.080569 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-User-Domain-Name: Default Aug 04 05:32:48.080569 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-User-Id: 9645255aa18b44a3952008e812b34360 Aug 04 05:32:48.080569 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-User-Name: tempest-VolumesNegativeTest-592855343-project Aug 04 05:32:48.080569 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: method: Aug 04 05:32:48.080569 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: exception: Volume bdc483d8-0e49-4a30-97b4-2e0c2a0b16ad could not be found. Aug 04 05:32:48.080569 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: action_args: {'id': 'bdc483d8-0e49-4a30-97b4-2e0c2a0b16ad'} Aug 04 05:32:48.080569 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 05:32:48.081493 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:32:48.081493 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 04 05:32:48.081493 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 04 05:32:48.081493 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 04 05:32:48.081493 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 04 05:32:48.081493 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 04 05:32:48.081493 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 04 05:32:48.081493 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 04 05:32:48.081493 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 04 05:32:48.081493 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 04 05:32:48.081493 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 04 05:32:48.081493 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 04 05:32:48.081493 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 04 05:32:48.081493 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 04 05:32:48.081493 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 04 05:32:48.081493 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume bdc483d8-0e49-4a30-97b4-2e0c2a0b16ad could not be found. (HTTP 404) (Request-ID: req-65ca9207-5439-465a-a544-9826737bac22) Aug 04 05:32:48.081493 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Aug 04 05:32:48.081493 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:32:48.081493 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Aug 04 05:32:48.082764 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:32:48.082764 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 04 05:32:48.082764 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 04 05:32:48.082764 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 04 05:32:48.082764 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 04 05:32:48.082764 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 04 05:32:48.082764 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 04 05:32:48.082764 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 04 05:32:48.082764 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 04 05:32:48.082764 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 04 05:32:48.082764 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 04 05:32:48.082764 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 04 05:32:48.082764 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 04 05:32:48.082764 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 04 05:32:48.082764 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 04 05:32:48.082764 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 04 05:32:48.082764 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 04 05:32:48.082764 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 04 05:32:48.082764 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 04 05:32:48.083859 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 04 05:32:48.083859 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 04 05:32:48.083859 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 04 05:32:48.083859 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 04 05:32:48.083859 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume bdc483d8-0e49-4a30-97b4-2e0c2a0b16ad could not be found. Aug 04 05:32:48.083859 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Aug 04 05:32:48.083859 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:32:48.083859 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Aug 04 05:32:48.083859 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:32:48.083859 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:32:48.083859 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:32:48.083859 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 05:32:48.083859 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 05:32:48.083859 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 05:32:48.083859 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 05:32:48.083859 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 05:32:48.083859 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 05:32:48.083859 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 04 05:32:48.083859 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 05:32:48.086975 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume bdc483d8-0e49-4a30-97b4-2e0c2a0b16ad could not be found. Aug 04 05:32:48.086975 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Aug 04 05:32:48.086975 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:32:48.086975 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Aug 04 05:32:48.086975 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:32:48.086975 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:32:48.086975 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:32:48.086975 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 05:32:48.086975 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 05:32:48.086975 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume bdc483d8-0e49-4a30-97b4-2e0c2a0b16ad could not be found. Aug 04 05:32:48.086975 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Aug 04 05:32:48.086975 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-7a452158-c499-4e56-a7b3-77ffa083f3fe tempest-VolumesNegativeTest-592855343 tempest-VolumesNegativeTest-592855343-project] Returning 404 to user: Volume bdc483d8-0e49-4a30-97b4-2e0c2a0b16ad could not be found. {{(pid=118477) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 05:32:48.086975 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-7a452158-c499-4e56-a7b3-77ffa083f3fe tempest-VolumesNegativeTest-592855343 tempest-VolumesNegativeTest-592855343-project] 10.222.0.46 "DELETE /compute/v2.1/os-volumes/bdc483d8-0e49-4a30-97b4-2e0c2a0b16ad" status: 404 len: 109 microversion: 2.1 time: 0.041512 Aug 04 05:32:48.086975 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 419/828] 10.222.0.46 () {58 vars in 1248 bytes} [Thu Aug 4 05:32:48 2022] DELETE /compute/v2.1/os-volumes/bdc483d8-0e49-4a30-97b4-2e0c2a0b16ad => generated 109 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 05:32:48.090683 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-0d004ff8-008e-4edb-a633-05170d1bd854 tempest-VolumesNegativeTest-592855343 tempest-VolumesNegativeTest-592855343-project] Calling method '.version_select at 0x7f147547a790>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:32:48.114980 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-e277e352-f278-4dc7-9d58-c2f90ef12985 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] [instance: 2e3bce83-6dff-479d-a54c-8f660fbbcdc5] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=118476) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Aug 04 05:32:48.123024 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.wsgi [None req-0d004ff8-008e-4edb-a633-05170d1bd854 tempest-VolumesNegativeTest-592855343 tempest-VolumesNegativeTest-592855343-project] HTTP exception thrown: Volume 1fefa9bd-e5b9-4012-8009-1ea67a0ccaec could not be found. Aug 04 05:32:48.125204 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-0d004ff8-008e-4edb-a633-05170d1bd854 tempest-VolumesNegativeTest-592855343 tempest-VolumesNegativeTest-592855343-project] Request method failure captured: Aug 04 05:32:48.125204 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: request: GET /compute/v2.1/os-volumes/1fefa9bd-e5b9-4012-8009-1ea67a0ccaec HTTP/1.1 Aug 04 05:32:48.125204 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: Accept: application/json Aug 04 05:32:48.125204 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: Accept-Encoding: identity Aug 04 05:32:48.125204 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: Connection: close Aug 04 05:32:48.125204 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: Content-Length: 0 Aug 04 05:32:48.125204 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: Content-Type: application/json Aug 04 05:32:48.125204 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: Host: 10.222.0.46 Aug 04 05:32:48.125204 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: Openstack-System-Scope: None Aug 04 05:32:48.125204 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: User-Agent: python-urllib3/1.26.11 Aug 04 05:32:48.125204 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Auth-Token: gAAAAABi61n_LghiVAzW7CKc66_zhhsmb7hEySJzbO0rEtlRY0yI22A5HFEZoYJeyTmYnZsMw2qiw1dH5bmzYK8QYAdNZdDE3nezBs3cyvM9Ak1ZAy10nqXXt1uCjX81_FV7VyeXMfTzjKQG2DC102bKd8EOsoLkUjA10qAvctVLuuxUpp3AjnQ Aug 04 05:32:48.125204 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Domain-Id: None Aug 04 05:32:48.125204 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Domain-Name: None Aug 04 05:32:48.125204 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Identity-Status: Confirmed Aug 04 05:32:48.125204 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Is-Admin-Project: True Aug 04 05:32:48.125204 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Project-Domain-Id: default Aug 04 05:32:48.125204 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Project-Domain-Name: Default Aug 04 05:32:48.125204 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Project-Id: a89ad700f80542beb03f216e9e51b6c4 Aug 04 05:32:48.125204 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Project-Name: tempest-VolumesNegativeTest-592855343 Aug 04 05:32:48.125204 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Role: member,reader Aug 04 05:32:48.125204 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Roles: member,reader Aug 04 05:32:48.131826 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/a89ad700f80542beb03f216e9e51b6c4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/a89ad700f80542beb03f216e9e51b6c4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_a89ad700f80542beb03f216e9e51b6c4", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/a89ad700f80542beb03f216e9e51b6c4"}]}] Aug 04 05:32:48.131826 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Tenant: tempest-VolumesNegativeTest-592855343 Aug 04 05:32:48.131826 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Tenant-Id: a89ad700f80542beb03f216e9e51b6c4 Aug 04 05:32:48.131826 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Tenant-Name: tempest-VolumesNegativeTest-592855343 Aug 04 05:32:48.131826 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-User: tempest-VolumesNegativeTest-592855343-project Aug 04 05:32:48.131826 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-User-Domain-Id: default Aug 04 05:32:48.131826 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-User-Domain-Name: Default Aug 04 05:32:48.131826 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-User-Id: 9645255aa18b44a3952008e812b34360 Aug 04 05:32:48.131826 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-User-Name: tempest-VolumesNegativeTest-592855343-project Aug 04 05:32:48.131826 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: method: Aug 04 05:32:48.131826 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: exception: Volume 1fefa9bd-e5b9-4012-8009-1ea67a0ccaec could not be found. Aug 04 05:32:48.131826 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: action_args: {'id': '1fefa9bd-e5b9-4012-8009-1ea67a0ccaec'} Aug 04 05:32:48.131826 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 05:32:48.132785 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:32:48.132785 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 04 05:32:48.132785 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 04 05:32:48.132785 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 04 05:32:48.132785 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 04 05:32:48.132785 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 04 05:32:48.132785 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 04 05:32:48.132785 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 04 05:32:48.132785 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 04 05:32:48.132785 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 04 05:32:48.132785 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 04 05:32:48.132785 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 04 05:32:48.132785 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 04 05:32:48.132785 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 04 05:32:48.132785 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 04 05:32:48.132785 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 1fefa9bd-e5b9-4012-8009-1ea67a0ccaec could not be found. (HTTP 404) (Request-ID: req-8bb252d3-2a67-483f-81f2-89341600f5a0) Aug 04 05:32:48.132785 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Aug 04 05:32:48.132785 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:32:48.132785 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Aug 04 05:32:48.134125 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:32:48.134125 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 04 05:32:48.134125 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 04 05:32:48.134125 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 04 05:32:48.134125 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 04 05:32:48.134125 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 04 05:32:48.134125 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 04 05:32:48.134125 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 04 05:32:48.134125 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 04 05:32:48.134125 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 04 05:32:48.134125 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 04 05:32:48.134125 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 04 05:32:48.134125 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 04 05:32:48.134125 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 04 05:32:48.134125 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 04 05:32:48.134125 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 04 05:32:48.134125 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 04 05:32:48.134125 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 04 05:32:48.134125 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 04 05:32:48.135463 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 04 05:32:48.135463 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 04 05:32:48.135463 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 04 05:32:48.135463 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 04 05:32:48.135463 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 1fefa9bd-e5b9-4012-8009-1ea67a0ccaec could not be found. Aug 04 05:32:48.135463 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Aug 04 05:32:48.135463 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:32:48.135463 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Aug 04 05:32:48.135463 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:32:48.135463 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:32:48.135463 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:32:48.135463 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 05:32:48.135463 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 05:32:48.135463 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 05:32:48.135463 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 05:32:48.135463 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 05:32:48.135463 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 05:32:48.135463 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 04 05:32:48.135463 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 05:32:48.136882 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 1fefa9bd-e5b9-4012-8009-1ea67a0ccaec could not be found. Aug 04 05:32:48.136882 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Aug 04 05:32:48.136882 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:32:48.136882 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Aug 04 05:32:48.136882 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:32:48.136882 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:32:48.136882 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:32:48.136882 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 05:32:48.136882 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 05:32:48.136882 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 1fefa9bd-e5b9-4012-8009-1ea67a0ccaec could not be found. Aug 04 05:32:48.136882 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Aug 04 05:32:48.136882 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-0d004ff8-008e-4edb-a633-05170d1bd854 tempest-VolumesNegativeTest-592855343 tempest-VolumesNegativeTest-592855343-project] Returning 404 to user: Volume 1fefa9bd-e5b9-4012-8009-1ea67a0ccaec could not be found. {{(pid=118477) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 05:32:48.136882 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-0d004ff8-008e-4edb-a633-05170d1bd854 tempest-VolumesNegativeTest-592855343 tempest-VolumesNegativeTest-592855343-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/1fefa9bd-e5b9-4012-8009-1ea67a0ccaec" status: 404 len: 109 microversion: 2.1 time: 0.041463 Aug 04 05:32:48.136882 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 420/829] 10.222.0.46 () {58 vars in 1245 bytes} [Thu Aug 4 05:32:48 2022] GET /compute/v2.1/os-volumes/1fefa9bd-e5b9-4012-8009-1ea67a0ccaec => generated 109 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 04 05:32:48.531061 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-e277e352-f278-4dc7-9d58-c2f90ef12985 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] 10.222.0.46 "POST /compute/v2.1/servers/2e3bce83-6dff-479d-a54c-8f660fbbcdc5/action" status: 202 len: 0 microversion: 2.20 time: 0.469070 Aug 04 05:32:48.531758 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 410/830] 10.222.0.46 () {62 vars in 1319 bytes} [Thu Aug 4 05:32:48 2022] POST /compute/v2.1/servers/2e3bce83-6dff-479d-a54c-8f660fbbcdc5/action => generated 0 bytes in 470 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 04 05:32:48.541199 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-c900a169-2f15-4cfc-8055-2350084e4868 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:32:48.542370 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-c900a169-2f15-4cfc-8055-2350084e4868 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] [instance: 2e3bce83-6dff-479d-a54c-8f660fbbcdc5] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:32:48.550251 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-c900a169-2f15-4cfc-8055-2350084e4868 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:32:48.554498 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-c900a169-2f15-4cfc-8055-2350084e4868 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:32:48.554498 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-c900a169-2f15-4cfc-8055-2350084e4868 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:32:48.554498 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-c900a169-2f15-4cfc-8055-2350084e4868 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:32:48.820241 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-c900a169-2f15-4cfc-8055-2350084e4868 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:32:48.831834 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-c900a169-2f15-4cfc-8055-2350084e4868 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:32:48.837389 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-c900a169-2f15-4cfc-8055-2350084e4868 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:32:48.837389 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-c900a169-2f15-4cfc-8055-2350084e4868 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] 10.222.0.46 "GET /compute/v2.1/servers/2e3bce83-6dff-479d-a54c-8f660fbbcdc5" status: 200 len: 1751 microversion: 2.20 time: 0.298324 Aug 04 05:32:48.837389 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 421/831] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Aug 4 05:32:48 2022] GET /compute/v2.1/servers/2e3bce83-6dff-479d-a54c-8f660fbbcdc5 => generated 1751 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 05:32:48.979662 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-beab0716-51ac-458d-8acc-3f027bdd8d1f tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:32:48.980320 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-beab0716-51ac-458d-8acc-3f027bdd8d1f tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] [instance: 9333850c-071c-4330-98b9-84232a752ffe] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:32:48.988614 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-beab0716-51ac-458d-8acc-3f027bdd8d1f tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:32:48.989135 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-beab0716-51ac-458d-8acc-3f027bdd8d1f tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:32:48.993046 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-beab0716-51ac-458d-8acc-3f027bdd8d1f tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:32:48.993046 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-beab0716-51ac-458d-8acc-3f027bdd8d1f tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:32:48.995185 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG dbcounter [-] [118476] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=6,nova_cell1:INSERT=5 {{(pid=118476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:32:49.005973 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.wsgi [None req-beab0716-51ac-458d-8acc-3f027bdd8d1f tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] HTTP exception thrown: Instance 9333850c-071c-4330-98b9-84232a752ffe could not be found. Aug 04 05:32:49.007819 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-beab0716-51ac-458d-8acc-3f027bdd8d1f tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Request method failure captured: Aug 04 05:32:49.007819 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: request: DELETE /compute/v2.1/servers/9333850c-071c-4330-98b9-84232a752ffe HTTP/1.1 Aug 04 05:32:49.007819 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: Accept: application/json Aug 04 05:32:49.007819 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: Accept-Encoding: identity Aug 04 05:32:49.007819 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: Connection: close Aug 04 05:32:49.007819 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: Content-Length: 0 Aug 04 05:32:49.007819 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: Content-Type: application/json Aug 04 05:32:49.007819 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: Host: 10.222.0.46 Aug 04 05:32:49.007819 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: Openstack-System-Scope: None Aug 04 05:32:49.007819 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: User-Agent: python-urllib3/1.26.11 Aug 04 05:32:49.007819 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Auth-Token: gAAAAABi61ibB27zcAqkTFBz3ZHZQBTyYLUiz1L71kTAJ1mIgw23NzfP3be8JfDUo2j8H621Gq4ZtR6Qkl_uc57pKHyYmWoyApQ0u1rcdhH843jVllSfSpyjvEna5qAHPkZneB2RW8yXCDwaidRZA-fexzYeio0C9gcFg53_Z47USjhBWgHa8uc Aug 04 05:32:49.007819 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Domain-Id: None Aug 04 05:32:49.007819 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Domain-Name: None Aug 04 05:32:49.007819 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Identity-Status: Confirmed Aug 04 05:32:49.007819 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Is-Admin-Project: True Aug 04 05:32:49.007819 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Project-Domain-Id: default Aug 04 05:32:49.007819 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Project-Domain-Name: Default Aug 04 05:32:49.007819 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Project-Id: d1ca4b83dc874bda9f33e06f4910608c Aug 04 05:32:49.007819 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Project-Name: tempest-AttachVolumeTestJSON-785443369 Aug 04 05:32:49.007819 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Role: member,reader Aug 04 05:32:49.007819 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Roles: member,reader Aug 04 05:32:49.009320 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/d1ca4b83dc874bda9f33e06f4910608c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/d1ca4b83dc874bda9f33e06f4910608c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_d1ca4b83dc874bda9f33e06f4910608c", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/d1ca4b83dc874bda9f33e06f4910608c"}]}] Aug 04 05:32:49.009320 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Tenant: tempest-AttachVolumeTestJSON-785443369 Aug 04 05:32:49.009320 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Tenant-Id: d1ca4b83dc874bda9f33e06f4910608c Aug 04 05:32:49.009320 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Tenant-Name: tempest-AttachVolumeTestJSON-785443369 Aug 04 05:32:49.009320 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-User: tempest-AttachVolumeTestJSON-785443369-project Aug 04 05:32:49.009320 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-User-Domain-Id: default Aug 04 05:32:49.009320 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-User-Domain-Name: Default Aug 04 05:32:49.009320 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-User-Id: eb4dea95659c473b9b193c6234186430 Aug 04 05:32:49.009320 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-User-Name: tempest-AttachVolumeTestJSON-785443369-project Aug 04 05:32:49.009320 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: method: > Aug 04 05:32:49.009320 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: exception: Instance 9333850c-071c-4330-98b9-84232a752ffe could not be found. Aug 04 05:32:49.009320 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: action_args: {'id': '9333850c-071c-4330-98b9-84232a752ffe'} Aug 04 05:32:49.010213 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 05:32:49.010213 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:32:49.010213 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 05:32:49.010213 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 05:32:49.010213 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 05:32:49.010213 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 05:32:49.010213 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 05:32:49.010213 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 05:32:49.010213 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 05:32:49.010213 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 05:32:49.010213 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9333850c-071c-4330-98b9-84232a752ffe could not be found. Aug 04 05:32:49.010213 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Aug 04 05:32:49.010213 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:32:49.010213 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Aug 04 05:32:49.010213 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:32:49.010213 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:32:49.010213 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:32:49.010213 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 05:32:49.010213 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 05:32:49.010213 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 05:32:49.011872 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 05:32:49.011872 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 05:32:49.011872 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 05:32:49.011872 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 05:32:49.011872 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 05:32:49.011872 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 05:32:49.011872 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 05:32:49.011872 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 05:32:49.011872 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 05:32:49.011872 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9333850c-071c-4330-98b9-84232a752ffe could not be found. Aug 04 05:32:49.011872 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Aug 04 05:32:49.011872 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:32:49.011872 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Aug 04 05:32:49.011872 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:32:49.011872 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:32:49.011872 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:32:49.011872 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 05:32:49.011872 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 05:32:49.011872 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9333850c-071c-4330-98b9-84232a752ffe could not be found. Aug 04 05:32:49.011872 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Aug 04 05:32:49.014073 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-beab0716-51ac-458d-8acc-3f027bdd8d1f tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Returning 404 to user: Instance 9333850c-071c-4330-98b9-84232a752ffe could not be found. {{(pid=118476) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 05:32:49.015038 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-beab0716-51ac-458d-8acc-3f027bdd8d1f tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] 10.222.0.46 "DELETE /compute/v2.1/servers/9333850c-071c-4330-98b9-84232a752ffe" status: 404 len: 111 microversion: 2.1 time: 0.040167 Aug 04 05:32:49.015634 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 411/832] 10.222.0.46 () {58 vars in 1239 bytes} [Thu Aug 4 05:32:48 2022] DELETE /compute/v2.1/servers/9333850c-071c-4330-98b9-84232a752ffe => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 05:32:49.024922 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-29cc428a-4cf6-4ee9-8048-1856acb673e4 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:32:49.025542 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-29cc428a-4cf6-4ee9-8048-1856acb673e4 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] [instance: 9333850c-071c-4330-98b9-84232a752ffe] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:32:49.034370 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-29cc428a-4cf6-4ee9-8048-1856acb673e4 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:32:49.034848 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-29cc428a-4cf6-4ee9-8048-1856acb673e4 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:32:49.035837 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-29cc428a-4cf6-4ee9-8048-1856acb673e4 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:32:49.036279 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-29cc428a-4cf6-4ee9-8048-1856acb673e4 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:32:49.051946 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.wsgi [None req-29cc428a-4cf6-4ee9-8048-1856acb673e4 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] HTTP exception thrown: Instance 9333850c-071c-4330-98b9-84232a752ffe could not be found. Aug 04 05:32:49.053498 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-29cc428a-4cf6-4ee9-8048-1856acb673e4 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Request method failure captured: Aug 04 05:32:49.053498 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: request: GET /compute/v2.1/servers/9333850c-071c-4330-98b9-84232a752ffe HTTP/1.1 Aug 04 05:32:49.053498 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: Accept: application/json Aug 04 05:32:49.053498 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: Accept-Encoding: identity Aug 04 05:32:49.053498 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: Connection: close Aug 04 05:32:49.053498 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: Content-Length: 0 Aug 04 05:32:49.053498 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: Content-Type: application/json Aug 04 05:32:49.053498 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: Host: 10.222.0.46 Aug 04 05:32:49.053498 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: Openstack-System-Scope: None Aug 04 05:32:49.053498 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: User-Agent: python-urllib3/1.26.11 Aug 04 05:32:49.053498 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Auth-Token: gAAAAABi61ibB27zcAqkTFBz3ZHZQBTyYLUiz1L71kTAJ1mIgw23NzfP3be8JfDUo2j8H621Gq4ZtR6Qkl_uc57pKHyYmWoyApQ0u1rcdhH843jVllSfSpyjvEna5qAHPkZneB2RW8yXCDwaidRZA-fexzYeio0C9gcFg53_Z47USjhBWgHa8uc Aug 04 05:32:49.053498 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Domain-Id: None Aug 04 05:32:49.053498 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Domain-Name: None Aug 04 05:32:49.053498 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Identity-Status: Confirmed Aug 04 05:32:49.053498 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Is-Admin-Project: True Aug 04 05:32:49.053498 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Project-Domain-Id: default Aug 04 05:32:49.053498 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Project-Domain-Name: Default Aug 04 05:32:49.053498 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Project-Id: d1ca4b83dc874bda9f33e06f4910608c Aug 04 05:32:49.053498 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Project-Name: tempest-AttachVolumeTestJSON-785443369 Aug 04 05:32:49.053498 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Role: member,reader Aug 04 05:32:49.053498 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Roles: member,reader Aug 04 05:32:49.055183 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/d1ca4b83dc874bda9f33e06f4910608c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/d1ca4b83dc874bda9f33e06f4910608c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_d1ca4b83dc874bda9f33e06f4910608c", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/d1ca4b83dc874bda9f33e06f4910608c"}]}] Aug 04 05:32:49.055183 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Tenant: tempest-AttachVolumeTestJSON-785443369 Aug 04 05:32:49.055183 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Tenant-Id: d1ca4b83dc874bda9f33e06f4910608c Aug 04 05:32:49.055183 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Tenant-Name: tempest-AttachVolumeTestJSON-785443369 Aug 04 05:32:49.055183 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-User: tempest-AttachVolumeTestJSON-785443369-project Aug 04 05:32:49.055183 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-User-Domain-Id: default Aug 04 05:32:49.055183 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-User-Domain-Name: Default Aug 04 05:32:49.055183 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-User-Id: eb4dea95659c473b9b193c6234186430 Aug 04 05:32:49.055183 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-User-Name: tempest-AttachVolumeTestJSON-785443369-project Aug 04 05:32:49.055183 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: method: > Aug 04 05:32:49.055183 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: exception: Instance 9333850c-071c-4330-98b9-84232a752ffe could not be found. Aug 04 05:32:49.055183 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: action_args: {'id': '9333850c-071c-4330-98b9-84232a752ffe'} Aug 04 05:32:49.056035 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 05:32:49.056035 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:32:49.056035 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 05:32:49.056035 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 05:32:49.056035 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 05:32:49.056035 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 05:32:49.056035 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 05:32:49.056035 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 05:32:49.056035 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 05:32:49.056035 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 05:32:49.056035 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9333850c-071c-4330-98b9-84232a752ffe could not be found. Aug 04 05:32:49.056035 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Aug 04 05:32:49.056035 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:32:49.056035 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Aug 04 05:32:49.056035 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:32:49.056035 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:32:49.056035 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:32:49.056035 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 05:32:49.056035 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 05:32:49.056035 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 05:32:49.057490 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 05:32:49.057490 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 05:32:49.057490 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 05:32:49.057490 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 05:32:49.057490 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 05:32:49.057490 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 05:32:49.057490 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 05:32:49.057490 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9333850c-071c-4330-98b9-84232a752ffe could not be found. Aug 04 05:32:49.057490 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Aug 04 05:32:49.057490 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:32:49.057490 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Aug 04 05:32:49.057490 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:32:49.057490 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:32:49.057490 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:32:49.057490 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 05:32:49.057490 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 05:32:49.057490 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9333850c-071c-4330-98b9-84232a752ffe could not be found. Aug 04 05:32:49.057490 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Aug 04 05:32:49.059619 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-29cc428a-4cf6-4ee9-8048-1856acb673e4 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] Returning 404 to user: Instance 9333850c-071c-4330-98b9-84232a752ffe could not be found. {{(pid=118477) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 05:32:49.059619 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-29cc428a-4cf6-4ee9-8048-1856acb673e4 tempest-AttachVolumeTestJSON-785443369 tempest-AttachVolumeTestJSON-785443369-project] 10.222.0.46 "GET /compute/v2.1/servers/9333850c-071c-4330-98b9-84232a752ffe" status: 404 len: 111 microversion: 2.1 time: 0.034142 Aug 04 05:32:49.059619 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 422/833] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:32:49 2022] GET /compute/v2.1/servers/9333850c-071c-4330-98b9-84232a752ffe => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 04 05:32:49.866758 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-ebb079fb-e8b8-480a-ab2f-5e58e522b8e5 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:32:49.866758 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-ebb079fb-e8b8-480a-ab2f-5e58e522b8e5 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] [instance: 2e3bce83-6dff-479d-a54c-8f660fbbcdc5] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:32:49.874570 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-ebb079fb-e8b8-480a-ab2f-5e58e522b8e5 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:32:49.875027 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-ebb079fb-e8b8-480a-ab2f-5e58e522b8e5 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:32:49.876538 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-ebb079fb-e8b8-480a-ab2f-5e58e522b8e5 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:32:49.877044 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-ebb079fb-e8b8-480a-ab2f-5e58e522b8e5 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:32:50.106485 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-ebb079fb-e8b8-480a-ab2f-5e58e522b8e5 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:32:50.123459 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-ebb079fb-e8b8-480a-ab2f-5e58e522b8e5 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:32:50.128338 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-ebb079fb-e8b8-480a-ab2f-5e58e522b8e5 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:32:50.133205 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-ebb079fb-e8b8-480a-ab2f-5e58e522b8e5 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] 10.222.0.46 "GET /compute/v2.1/servers/2e3bce83-6dff-479d-a54c-8f660fbbcdc5" status: 200 len: 1751 microversion: 2.20 time: 0.274965 Aug 04 05:32:50.133205 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 412/834] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Aug 4 05:32:49 2022] GET /compute/v2.1/servers/2e3bce83-6dff-479d-a54c-8f660fbbcdc5 => generated 1751 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 05:32:51.154977 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-ef10daa4-5428-444e-ae75-c86fe5bcefe2 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:32:51.155713 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-ef10daa4-5428-444e-ae75-c86fe5bcefe2 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] [instance: 2e3bce83-6dff-479d-a54c-8f660fbbcdc5] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:32:51.176332 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-ef10daa4-5428-444e-ae75-c86fe5bcefe2 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:32:51.176831 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-ef10daa4-5428-444e-ae75-c86fe5bcefe2 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:32:51.177850 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-ef10daa4-5428-444e-ae75-c86fe5bcefe2 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:32:51.179721 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-ef10daa4-5428-444e-ae75-c86fe5bcefe2 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:32:51.347530 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-ef10daa4-5428-444e-ae75-c86fe5bcefe2 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:32:51.370103 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-ef10daa4-5428-444e-ae75-c86fe5bcefe2 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:32:51.372655 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-ef10daa4-5428-444e-ae75-c86fe5bcefe2 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:32:51.374075 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-ef10daa4-5428-444e-ae75-c86fe5bcefe2 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] 10.222.0.46 "GET /compute/v2.1/servers/2e3bce83-6dff-479d-a54c-8f660fbbcdc5" status: 200 len: 1753 microversion: 2.20 time: 0.223799 Aug 04 05:32:51.378705 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 423/835] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Aug 4 05:32:51 2022] GET /compute/v2.1/servers/2e3bce83-6dff-479d-a54c-8f660fbbcdc5 => generated 1753 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 05:32:52.399602 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-60e484cf-401a-46db-9f64-27c803982c64 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:32:52.400938 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-60e484cf-401a-46db-9f64-27c803982c64 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] [instance: 2e3bce83-6dff-479d-a54c-8f660fbbcdc5] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:32:52.410384 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-60e484cf-401a-46db-9f64-27c803982c64 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:32:52.411944 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-60e484cf-401a-46db-9f64-27c803982c64 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:32:52.414143 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-60e484cf-401a-46db-9f64-27c803982c64 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:32:52.415165 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-60e484cf-401a-46db-9f64-27c803982c64 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:32:52.653037 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-60e484cf-401a-46db-9f64-27c803982c64 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:32:52.696189 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-60e484cf-401a-46db-9f64-27c803982c64 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:32:52.702951 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-60e484cf-401a-46db-9f64-27c803982c64 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:32:52.707089 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-60e484cf-401a-46db-9f64-27c803982c64 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] 10.222.0.46 "GET /compute/v2.1/servers/2e3bce83-6dff-479d-a54c-8f660fbbcdc5" status: 200 len: 1753 microversion: 2.20 time: 0.311997 Aug 04 05:32:52.713432 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 413/836] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Aug 4 05:32:52 2022] GET /compute/v2.1/servers/2e3bce83-6dff-479d-a54c-8f660fbbcdc5 => generated 1753 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 05:32:53.741550 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-73814499-e7c4-4d73-9f26-31f0e33c45f1 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:32:53.742916 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-73814499-e7c4-4d73-9f26-31f0e33c45f1 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] [instance: 2e3bce83-6dff-479d-a54c-8f660fbbcdc5] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:32:53.755506 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-73814499-e7c4-4d73-9f26-31f0e33c45f1 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:32:53.755931 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-73814499-e7c4-4d73-9f26-31f0e33c45f1 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:32:53.758691 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-73814499-e7c4-4d73-9f26-31f0e33c45f1 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:32:53.759147 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-73814499-e7c4-4d73-9f26-31f0e33c45f1 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:32:53.779261 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG dbcounter [-] [118477] Writing DB stats nova_cell1:SELECT=100 {{(pid=118477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:32:54.206763 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-73814499-e7c4-4d73-9f26-31f0e33c45f1 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:32:54.216639 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-73814499-e7c4-4d73-9f26-31f0e33c45f1 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:32:54.218646 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-73814499-e7c4-4d73-9f26-31f0e33c45f1 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:32:54.234024 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-73814499-e7c4-4d73-9f26-31f0e33c45f1 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] 10.222.0.46 "GET /compute/v2.1/servers/2e3bce83-6dff-479d-a54c-8f660fbbcdc5" status: 200 len: 1809 microversion: 2.20 time: 0.496454 Aug 04 05:32:54.237333 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 424/837] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Aug 4 05:32:53 2022] GET /compute/v2.1/servers/2e3bce83-6dff-479d-a54c-8f660fbbcdc5 => generated 1809 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 05:32:55.262643 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-a0e4a89f-1ff1-4888-97d6-6473c0065c46 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:32:55.264374 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-a0e4a89f-1ff1-4888-97d6-6473c0065c46 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] [instance: 2e3bce83-6dff-479d-a54c-8f660fbbcdc5] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:32:55.277439 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-a0e4a89f-1ff1-4888-97d6-6473c0065c46 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:32:55.279372 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-a0e4a89f-1ff1-4888-97d6-6473c0065c46 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:32:55.280716 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-a0e4a89f-1ff1-4888-97d6-6473c0065c46 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:32:55.284221 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-a0e4a89f-1ff1-4888-97d6-6473c0065c46 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:32:55.638766 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-a0e4a89f-1ff1-4888-97d6-6473c0065c46 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:32:55.655547 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-a0e4a89f-1ff1-4888-97d6-6473c0065c46 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:32:55.662376 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-a0e4a89f-1ff1-4888-97d6-6473c0065c46 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:32:55.664133 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-a0e4a89f-1ff1-4888-97d6-6473c0065c46 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] 10.222.0.46 "GET /compute/v2.1/servers/2e3bce83-6dff-479d-a54c-8f660fbbcdc5" status: 200 len: 1809 microversion: 2.20 time: 0.407326 Aug 04 05:32:55.674958 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 414/838] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Aug 4 05:32:55 2022] GET /compute/v2.1/servers/2e3bce83-6dff-479d-a54c-8f660fbbcdc5 => generated 1809 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 05:32:56.693954 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-4fe776d1-f7da-440e-8f95-ad3b0299149b tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:32:56.697342 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-4fe776d1-f7da-440e-8f95-ad3b0299149b tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] [instance: 2e3bce83-6dff-479d-a54c-8f660fbbcdc5] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:32:56.711419 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-4fe776d1-f7da-440e-8f95-ad3b0299149b tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:32:56.711882 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-4fe776d1-f7da-440e-8f95-ad3b0299149b tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:32:56.712703 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-4fe776d1-f7da-440e-8f95-ad3b0299149b tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:32:56.718959 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-4fe776d1-f7da-440e-8f95-ad3b0299149b tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:32:57.031259 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-4fe776d1-f7da-440e-8f95-ad3b0299149b tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:32:57.044289 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-4fe776d1-f7da-440e-8f95-ad3b0299149b tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:32:57.047425 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-4fe776d1-f7da-440e-8f95-ad3b0299149b tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:32:57.051272 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-4fe776d1-f7da-440e-8f95-ad3b0299149b tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] 10.222.0.46 "GET /compute/v2.1/servers/2e3bce83-6dff-479d-a54c-8f660fbbcdc5" status: 200 len: 1809 microversion: 2.20 time: 0.361189 Aug 04 05:32:57.053091 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 425/839] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Aug 4 05:32:56 2022] GET /compute/v2.1/servers/2e3bce83-6dff-479d-a54c-8f660fbbcdc5 => generated 1809 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 05:32:58.084972 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-e19f0966-0eaf-450e-868e-277c0740f431 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:32:58.086302 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-e19f0966-0eaf-450e-868e-277c0740f431 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] [instance: 2e3bce83-6dff-479d-a54c-8f660fbbcdc5] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:32:58.099958 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-e19f0966-0eaf-450e-868e-277c0740f431 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:32:58.100499 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-e19f0966-0eaf-450e-868e-277c0740f431 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:32:58.101131 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-e19f0966-0eaf-450e-868e-277c0740f431 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:32:58.101749 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-e19f0966-0eaf-450e-868e-277c0740f431 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:32:58.406900 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-e19f0966-0eaf-450e-868e-277c0740f431 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:32:58.418627 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-e19f0966-0eaf-450e-868e-277c0740f431 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:32:58.422114 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-e19f0966-0eaf-450e-868e-277c0740f431 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:32:58.423676 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-e19f0966-0eaf-450e-868e-277c0740f431 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] 10.222.0.46 "GET /compute/v2.1/servers/2e3bce83-6dff-479d-a54c-8f660fbbcdc5" status: 200 len: 1809 microversion: 2.20 time: 0.347129 Aug 04 05:32:58.424777 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 415/840] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Aug 4 05:32:58 2022] GET /compute/v2.1/servers/2e3bce83-6dff-479d-a54c-8f660fbbcdc5 => generated 1809 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 05:32:59.449223 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-27b8f218-ac29-4046-833c-c210dc5d395c tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:32:59.449909 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-27b8f218-ac29-4046-833c-c210dc5d395c tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] [instance: 2e3bce83-6dff-479d-a54c-8f660fbbcdc5] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:32:59.467463 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-27b8f218-ac29-4046-833c-c210dc5d395c tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:32:59.468205 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-27b8f218-ac29-4046-833c-c210dc5d395c tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:32:59.470424 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-27b8f218-ac29-4046-833c-c210dc5d395c tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:32:59.481090 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-27b8f218-ac29-4046-833c-c210dc5d395c tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:32:59.712676 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-27b8f218-ac29-4046-833c-c210dc5d395c tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:32:59.725616 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-27b8f218-ac29-4046-833c-c210dc5d395c tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:32:59.728134 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-27b8f218-ac29-4046-833c-c210dc5d395c tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:32:59.729681 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-27b8f218-ac29-4046-833c-c210dc5d395c tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] 10.222.0.46 "GET /compute/v2.1/servers/2e3bce83-6dff-479d-a54c-8f660fbbcdc5" status: 200 len: 1809 microversion: 2.20 time: 0.284418 Aug 04 05:32:59.730490 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 426/841] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Aug 4 05:32:59 2022] GET /compute/v2.1/servers/2e3bce83-6dff-479d-a54c-8f660fbbcdc5 => generated 1809 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 05:33:00.756789 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-fe918900-a55f-4f9f-9897-490a29d99acb tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:33:00.758154 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-fe918900-a55f-4f9f-9897-490a29d99acb tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] [instance: 2e3bce83-6dff-479d-a54c-8f660fbbcdc5] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:33:00.765361 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-fe918900-a55f-4f9f-9897-490a29d99acb tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:33:00.766959 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-fe918900-a55f-4f9f-9897-490a29d99acb tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:33:00.766959 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-fe918900-a55f-4f9f-9897-490a29d99acb tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:33:00.767417 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-fe918900-a55f-4f9f-9897-490a29d99acb tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:33:00.930745 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-fe918900-a55f-4f9f-9897-490a29d99acb tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:33:00.948870 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-fe918900-a55f-4f9f-9897-490a29d99acb tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:33:00.948870 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-fe918900-a55f-4f9f-9897-490a29d99acb tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:33:00.948870 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-fe918900-a55f-4f9f-9897-490a29d99acb tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] 10.222.0.46 "GET /compute/v2.1/servers/2e3bce83-6dff-479d-a54c-8f660fbbcdc5" status: 200 len: 1809 microversion: 2.20 time: 0.195164 Aug 04 05:33:00.949461 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 416/842] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Aug 4 05:33:00 2022] GET /compute/v2.1/servers/2e3bce83-6dff-479d-a54c-8f660fbbcdc5 => generated 1809 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 05:33:01.973707 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-384406a0-b054-4bf6-9b1c-054c84c834a3 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:33:01.975414 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-384406a0-b054-4bf6-9b1c-054c84c834a3 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] [instance: 2e3bce83-6dff-479d-a54c-8f660fbbcdc5] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:33:01.983789 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-384406a0-b054-4bf6-9b1c-054c84c834a3 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:33:01.984266 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-384406a0-b054-4bf6-9b1c-054c84c834a3 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:33:01.985797 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-384406a0-b054-4bf6-9b1c-054c84c834a3 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:33:01.986460 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-384406a0-b054-4bf6-9b1c-054c84c834a3 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:33:02.154788 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-384406a0-b054-4bf6-9b1c-054c84c834a3 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:33:02.165080 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-384406a0-b054-4bf6-9b1c-054c84c834a3 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:33:02.167022 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-384406a0-b054-4bf6-9b1c-054c84c834a3 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:33:02.168610 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-384406a0-b054-4bf6-9b1c-054c84c834a3 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] 10.222.0.46 "GET /compute/v2.1/servers/2e3bce83-6dff-479d-a54c-8f660fbbcdc5" status: 200 len: 1809 microversion: 2.20 time: 0.199920 Aug 04 05:33:02.174713 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 427/843] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Aug 4 05:33:01 2022] GET /compute/v2.1/servers/2e3bce83-6dff-479d-a54c-8f660fbbcdc5 => generated 1809 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 05:33:03.197572 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-cf4dcdaa-0980-4d34-8bf6-71681060563c tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:33:03.198190 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-cf4dcdaa-0980-4d34-8bf6-71681060563c tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] [instance: 2e3bce83-6dff-479d-a54c-8f660fbbcdc5] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:33:03.215182 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-cf4dcdaa-0980-4d34-8bf6-71681060563c tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:33:03.215182 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-cf4dcdaa-0980-4d34-8bf6-71681060563c tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:33:03.216536 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-cf4dcdaa-0980-4d34-8bf6-71681060563c tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:33:03.217415 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-cf4dcdaa-0980-4d34-8bf6-71681060563c tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:33:03.416215 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-cf4dcdaa-0980-4d34-8bf6-71681060563c tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:33:03.426665 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-cf4dcdaa-0980-4d34-8bf6-71681060563c tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:33:03.428497 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-cf4dcdaa-0980-4d34-8bf6-71681060563c tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:33:03.429862 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-cf4dcdaa-0980-4d34-8bf6-71681060563c tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] 10.222.0.46 "GET /compute/v2.1/servers/2e3bce83-6dff-479d-a54c-8f660fbbcdc5" status: 200 len: 1809 microversion: 2.20 time: 0.241883 Aug 04 05:33:03.432129 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 417/844] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Aug 4 05:33:03 2022] GET /compute/v2.1/servers/2e3bce83-6dff-479d-a54c-8f660fbbcdc5 => generated 1809 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 05:33:04.457693 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-c5fd5463-3f40-44fd-a5db-49ea924a6355 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:33:04.459650 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-c5fd5463-3f40-44fd-a5db-49ea924a6355 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] [instance: 2e3bce83-6dff-479d-a54c-8f660fbbcdc5] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:33:04.466258 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-c5fd5463-3f40-44fd-a5db-49ea924a6355 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:33:04.466722 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-c5fd5463-3f40-44fd-a5db-49ea924a6355 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:33:04.467511 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-c5fd5463-3f40-44fd-a5db-49ea924a6355 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:33:04.467939 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-c5fd5463-3f40-44fd-a5db-49ea924a6355 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:33:04.630376 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-c5fd5463-3f40-44fd-a5db-49ea924a6355 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:33:04.640948 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-c5fd5463-3f40-44fd-a5db-49ea924a6355 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:33:04.643718 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-c5fd5463-3f40-44fd-a5db-49ea924a6355 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:33:04.644780 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-c5fd5463-3f40-44fd-a5db-49ea924a6355 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] 10.222.0.46 "GET /compute/v2.1/servers/2e3bce83-6dff-479d-a54c-8f660fbbcdc5" status: 200 len: 1809 microversion: 2.20 time: 0.193267 Aug 04 05:33:04.645352 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 428/845] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Aug 4 05:33:04 2022] GET /compute/v2.1/servers/2e3bce83-6dff-479d-a54c-8f660fbbcdc5 => generated 1809 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 05:33:05.668311 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-c01e8017-c3d5-42aa-84cc-8a61c327a3c9 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:33:05.669180 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-c01e8017-c3d5-42aa-84cc-8a61c327a3c9 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] [instance: 2e3bce83-6dff-479d-a54c-8f660fbbcdc5] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:33:05.671608 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG dbcounter [-] [118476] Writing DB stats nova_api:SELECT=79,nova_api:DELETE=1,nova_api:UPDATE=3 {{(pid=118476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:33:05.677515 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-c01e8017-c3d5-42aa-84cc-8a61c327a3c9 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:33:05.680066 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-c01e8017-c3d5-42aa-84cc-8a61c327a3c9 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:33:05.680066 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-c01e8017-c3d5-42aa-84cc-8a61c327a3c9 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:33:05.680066 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-c01e8017-c3d5-42aa-84cc-8a61c327a3c9 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:33:05.822057 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-c01e8017-c3d5-42aa-84cc-8a61c327a3c9 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:33:05.831689 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-c01e8017-c3d5-42aa-84cc-8a61c327a3c9 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:33:05.833227 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-c01e8017-c3d5-42aa-84cc-8a61c327a3c9 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:33:05.834390 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-c01e8017-c3d5-42aa-84cc-8a61c327a3c9 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] 10.222.0.46 "GET /compute/v2.1/servers/2e3bce83-6dff-479d-a54c-8f660fbbcdc5" status: 200 len: 1809 microversion: 2.20 time: 0.170374 Aug 04 05:33:05.834950 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 418/846] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Aug 4 05:33:05 2022] GET /compute/v2.1/servers/2e3bce83-6dff-479d-a54c-8f660fbbcdc5 => generated 1809 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 05:33:06.857760 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-7247fb6d-e157-49e7-a42f-d73c089de609 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:33:06.859043 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-7247fb6d-e157-49e7-a42f-d73c089de609 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] [instance: 2e3bce83-6dff-479d-a54c-8f660fbbcdc5] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:33:06.862657 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG dbcounter [-] [118477] Writing DB stats nova_api:SELECT=60,nova_api:DELETE=2 {{(pid=118477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:33:06.867472 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-7247fb6d-e157-49e7-a42f-d73c089de609 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:33:06.867913 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-7247fb6d-e157-49e7-a42f-d73c089de609 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:33:06.868795 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-7247fb6d-e157-49e7-a42f-d73c089de609 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:33:06.869144 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-7247fb6d-e157-49e7-a42f-d73c089de609 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:33:07.007799 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-7247fb6d-e157-49e7-a42f-d73c089de609 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:33:07.017792 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-7247fb6d-e157-49e7-a42f-d73c089de609 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:33:07.018623 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-7247fb6d-e157-49e7-a42f-d73c089de609 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:33:07.019834 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-7247fb6d-e157-49e7-a42f-d73c089de609 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] 10.222.0.46 "GET /compute/v2.1/servers/2e3bce83-6dff-479d-a54c-8f660fbbcdc5" status: 200 len: 1809 microversion: 2.20 time: 0.166008 Aug 04 05:33:07.020638 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 429/847] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Aug 4 05:33:06 2022] GET /compute/v2.1/servers/2e3bce83-6dff-479d-a54c-8f660fbbcdc5 => generated 1809 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 05:33:08.044378 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-74ffc0ec-8c5b-4de9-a290-9f4ddf95809e tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:33:08.044988 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-74ffc0ec-8c5b-4de9-a290-9f4ddf95809e tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] [instance: 2e3bce83-6dff-479d-a54c-8f660fbbcdc5] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:33:08.052016 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-74ffc0ec-8c5b-4de9-a290-9f4ddf95809e tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:33:08.052465 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-74ffc0ec-8c5b-4de9-a290-9f4ddf95809e tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:33:08.053240 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-74ffc0ec-8c5b-4de9-a290-9f4ddf95809e tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:33:08.053678 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-74ffc0ec-8c5b-4de9-a290-9f4ddf95809e tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:33:08.196986 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-74ffc0ec-8c5b-4de9-a290-9f4ddf95809e tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:33:08.206175 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-74ffc0ec-8c5b-4de9-a290-9f4ddf95809e tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:33:08.207720 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-74ffc0ec-8c5b-4de9-a290-9f4ddf95809e tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:33:08.208876 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-74ffc0ec-8c5b-4de9-a290-9f4ddf95809e tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] 10.222.0.46 "GET /compute/v2.1/servers/2e3bce83-6dff-479d-a54c-8f660fbbcdc5" status: 200 len: 1809 microversion: 2.20 time: 0.168841 Aug 04 05:33:08.209437 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 419/848] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Aug 4 05:33:08 2022] GET /compute/v2.1/servers/2e3bce83-6dff-479d-a54c-8f660fbbcdc5 => generated 1809 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 05:33:09.233104 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-9d82d82f-d91d-4b1f-aaea-2123a4d3aa9b tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:33:09.233744 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-9d82d82f-d91d-4b1f-aaea-2123a4d3aa9b tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] [instance: 2e3bce83-6dff-479d-a54c-8f660fbbcdc5] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:33:09.244930 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-9d82d82f-d91d-4b1f-aaea-2123a4d3aa9b tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:33:09.245378 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-9d82d82f-d91d-4b1f-aaea-2123a4d3aa9b tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:33:09.246144 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-9d82d82f-d91d-4b1f-aaea-2123a4d3aa9b tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:33:09.246667 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-9d82d82f-d91d-4b1f-aaea-2123a4d3aa9b tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:33:09.411483 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-9d82d82f-d91d-4b1f-aaea-2123a4d3aa9b tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:33:09.420123 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-9d82d82f-d91d-4b1f-aaea-2123a4d3aa9b tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:33:09.421611 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-9d82d82f-d91d-4b1f-aaea-2123a4d3aa9b tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:33:09.422862 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-9d82d82f-d91d-4b1f-aaea-2123a4d3aa9b tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] 10.222.0.46 "GET /compute/v2.1/servers/2e3bce83-6dff-479d-a54c-8f660fbbcdc5" status: 200 len: 1809 microversion: 2.20 time: 0.193823 Aug 04 05:33:09.423518 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 430/849] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Aug 4 05:33:09 2022] GET /compute/v2.1/servers/2e3bce83-6dff-479d-a54c-8f660fbbcdc5 => generated 1809 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 05:33:10.448228 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-62fecb4a-b0ff-4046-9829-b16b73ed8600 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:33:10.448828 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-62fecb4a-b0ff-4046-9829-b16b73ed8600 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] [instance: 2e3bce83-6dff-479d-a54c-8f660fbbcdc5] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:33:10.455684 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-62fecb4a-b0ff-4046-9829-b16b73ed8600 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:33:10.456719 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-62fecb4a-b0ff-4046-9829-b16b73ed8600 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:33:10.457675 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-62fecb4a-b0ff-4046-9829-b16b73ed8600 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:33:10.458105 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-62fecb4a-b0ff-4046-9829-b16b73ed8600 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:33:10.599625 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-62fecb4a-b0ff-4046-9829-b16b73ed8600 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:33:10.608074 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-62fecb4a-b0ff-4046-9829-b16b73ed8600 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:33:10.609583 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-62fecb4a-b0ff-4046-9829-b16b73ed8600 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:33:10.610803 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-62fecb4a-b0ff-4046-9829-b16b73ed8600 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] 10.222.0.46 "GET /compute/v2.1/servers/2e3bce83-6dff-479d-a54c-8f660fbbcdc5" status: 200 len: 1809 microversion: 2.20 time: 0.167028 Aug 04 05:33:10.611364 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 420/850] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Aug 4 05:33:10 2022] GET /compute/v2.1/servers/2e3bce83-6dff-479d-a54c-8f660fbbcdc5 => generated 1809 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 05:33:11.636156 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-fc14be1c-b61d-49c9-ade9-cba31d3a1abe tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:33:11.636778 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-fc14be1c-b61d-49c9-ade9-cba31d3a1abe tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] [instance: 2e3bce83-6dff-479d-a54c-8f660fbbcdc5] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:33:11.643136 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-fc14be1c-b61d-49c9-ade9-cba31d3a1abe tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:33:11.643817 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-fc14be1c-b61d-49c9-ade9-cba31d3a1abe tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:33:11.644639 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-fc14be1c-b61d-49c9-ade9-cba31d3a1abe tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:33:11.645066 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-fc14be1c-b61d-49c9-ade9-cba31d3a1abe tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:33:11.785118 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-fc14be1c-b61d-49c9-ade9-cba31d3a1abe tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:33:11.794225 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-fc14be1c-b61d-49c9-ade9-cba31d3a1abe tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:33:11.795807 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-fc14be1c-b61d-49c9-ade9-cba31d3a1abe tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:33:11.796960 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-fc14be1c-b61d-49c9-ade9-cba31d3a1abe tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] 10.222.0.46 "GET /compute/v2.1/servers/2e3bce83-6dff-479d-a54c-8f660fbbcdc5" status: 200 len: 1809 microversion: 2.20 time: 0.164678 Aug 04 05:33:11.797506 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 431/851] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Aug 4 05:33:11 2022] GET /compute/v2.1/servers/2e3bce83-6dff-479d-a54c-8f660fbbcdc5 => generated 1809 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 05:33:12.821492 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-e7306ca0-b8fa-40cb-aebe-be8cc8831b12 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:33:12.822149 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-e7306ca0-b8fa-40cb-aebe-be8cc8831b12 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] [instance: 2e3bce83-6dff-479d-a54c-8f660fbbcdc5] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:33:12.828800 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-e7306ca0-b8fa-40cb-aebe-be8cc8831b12 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:33:12.829247 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-e7306ca0-b8fa-40cb-aebe-be8cc8831b12 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:33:12.830012 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-e7306ca0-b8fa-40cb-aebe-be8cc8831b12 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:33:12.830489 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-e7306ca0-b8fa-40cb-aebe-be8cc8831b12 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:33:12.964395 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-e7306ca0-b8fa-40cb-aebe-be8cc8831b12 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:33:12.974415 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-e7306ca0-b8fa-40cb-aebe-be8cc8831b12 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:33:12.975919 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-e7306ca0-b8fa-40cb-aebe-be8cc8831b12 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:33:12.977077 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-e7306ca0-b8fa-40cb-aebe-be8cc8831b12 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] 10.222.0.46 "GET /compute/v2.1/servers/2e3bce83-6dff-479d-a54c-8f660fbbcdc5" status: 200 len: 1809 microversion: 2.20 time: 0.159544 Aug 04 05:33:12.977627 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 421/852] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Aug 4 05:33:12 2022] GET /compute/v2.1/servers/2e3bce83-6dff-479d-a54c-8f660fbbcdc5 => generated 1809 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 05:33:14.001338 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-28cb7975-7d95-43a7-8c53-af3286e711f7 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:33:14.001941 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-28cb7975-7d95-43a7-8c53-af3286e711f7 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] [instance: 2e3bce83-6dff-479d-a54c-8f660fbbcdc5] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:33:14.012001 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-28cb7975-7d95-43a7-8c53-af3286e711f7 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:33:14.014077 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-28cb7975-7d95-43a7-8c53-af3286e711f7 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:33:14.015059 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-28cb7975-7d95-43a7-8c53-af3286e711f7 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:33:14.015494 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-28cb7975-7d95-43a7-8c53-af3286e711f7 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:33:14.156213 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-28cb7975-7d95-43a7-8c53-af3286e711f7 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:33:14.169304 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-28cb7975-7d95-43a7-8c53-af3286e711f7 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:33:14.170951 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-28cb7975-7d95-43a7-8c53-af3286e711f7 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:33:14.172119 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-28cb7975-7d95-43a7-8c53-af3286e711f7 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] 10.222.0.46 "GET /compute/v2.1/servers/2e3bce83-6dff-479d-a54c-8f660fbbcdc5" status: 200 len: 1809 microversion: 2.20 time: 0.174888 Aug 04 05:33:14.172672 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 432/853] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Aug 4 05:33:13 2022] GET /compute/v2.1/servers/2e3bce83-6dff-479d-a54c-8f660fbbcdc5 => generated 1809 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 05:33:15.195559 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-2374f39b-8ff9-4cbe-b9e6-77332d847fa0 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:33:15.196159 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-2374f39b-8ff9-4cbe-b9e6-77332d847fa0 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] [instance: 2e3bce83-6dff-479d-a54c-8f660fbbcdc5] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:33:15.202781 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-2374f39b-8ff9-4cbe-b9e6-77332d847fa0 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:33:15.203137 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-2374f39b-8ff9-4cbe-b9e6-77332d847fa0 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:33:15.203905 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-2374f39b-8ff9-4cbe-b9e6-77332d847fa0 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:33:15.204331 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-2374f39b-8ff9-4cbe-b9e6-77332d847fa0 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:33:15.343152 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-2374f39b-8ff9-4cbe-b9e6-77332d847fa0 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:33:15.353309 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-2374f39b-8ff9-4cbe-b9e6-77332d847fa0 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:33:15.354851 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-2374f39b-8ff9-4cbe-b9e6-77332d847fa0 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:33:15.356017 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-2374f39b-8ff9-4cbe-b9e6-77332d847fa0 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] 10.222.0.46 "GET /compute/v2.1/servers/2e3bce83-6dff-479d-a54c-8f660fbbcdc5" status: 200 len: 1809 microversion: 2.20 time: 0.164326 Aug 04 05:33:15.356576 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 422/854] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Aug 4 05:33:15 2022] GET /compute/v2.1/servers/2e3bce83-6dff-479d-a54c-8f660fbbcdc5 => generated 1809 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 05:33:15.630785 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [req-7bbb150c-6efc-4096-a0ae-51d06b3a4d18 req-cb2cca48-10a5-48c2-8d55-0cebc5a7e31a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e3bce83-6dff-479d-a54c-8f660fbbcdc5", "name": "network-vif-plugged", "status": "completed", "tag": "ddeaefd6-9468-4764-8ef0-df45fd5ea8db"}]} {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:33:15.643979 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [req-7bbb150c-6efc-4096-a0ae-51d06b3a4d18 req-cb2cca48-10a5-48c2-8d55-0cebc5a7e31a service nova] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:33:15.644437 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [req-7bbb150c-6efc-4096-a0ae-51d06b3a4d18 req-cb2cca48-10a5-48c2-8d55-0cebc5a7e31a service nova] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:33:15.655780 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.compute.server_external_events [req-7bbb150c-6efc-4096-a0ae-51d06b3a4d18 req-cb2cca48-10a5-48c2-8d55-0cebc5a7e31a service nova] Creating event network-vif-plugged:ddeaefd6-9468-4764-8ef0-df45fd5ea8db for instance 2e3bce83-6dff-479d-a54c-8f660fbbcdc5 on hv-cinder-85207 Aug 04 05:33:15.661756 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [req-7bbb150c-6efc-4096-a0ae-51d06b3a4d18 req-cb2cca48-10a5-48c2-8d55-0cebc5a7e31a service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035116 Aug 04 05:33:15.662375 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 433/855] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Aug 4 05:33:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:33:16.380595 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-43fa620c-383d-4f4f-9a79-bee54952de57 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:33:16.381917 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-43fa620c-383d-4f4f-9a79-bee54952de57 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] [instance: 2e3bce83-6dff-479d-a54c-8f660fbbcdc5] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:33:16.388665 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-43fa620c-383d-4f4f-9a79-bee54952de57 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:33:16.389117 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-43fa620c-383d-4f4f-9a79-bee54952de57 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:33:16.389889 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-43fa620c-383d-4f4f-9a79-bee54952de57 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:33:16.390343 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-43fa620c-383d-4f4f-9a79-bee54952de57 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:33:16.536359 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-43fa620c-383d-4f4f-9a79-bee54952de57 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:33:16.549740 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-43fa620c-383d-4f4f-9a79-bee54952de57 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:33:16.549740 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-43fa620c-383d-4f4f-9a79-bee54952de57 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:33:16.549740 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-43fa620c-383d-4f4f-9a79-bee54952de57 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] 10.222.0.46 "GET /compute/v2.1/servers/2e3bce83-6dff-479d-a54c-8f660fbbcdc5" status: 200 len: 1809 microversion: 2.20 time: 0.172568 Aug 04 05:33:16.550154 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 423/856] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Aug 4 05:33:16 2022] GET /compute/v2.1/servers/2e3bce83-6dff-479d-a54c-8f660fbbcdc5 => generated 1809 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 05:33:17.576673 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-05847ae1-e632-47a1-b0b5-c9217c7f132e tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:33:17.577759 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-05847ae1-e632-47a1-b0b5-c9217c7f132e tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] [instance: 2e3bce83-6dff-479d-a54c-8f660fbbcdc5] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:33:17.585851 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-05847ae1-e632-47a1-b0b5-c9217c7f132e tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:33:17.586419 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-05847ae1-e632-47a1-b0b5-c9217c7f132e tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:33:17.587440 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-05847ae1-e632-47a1-b0b5-c9217c7f132e tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:33:17.588249 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-05847ae1-e632-47a1-b0b5-c9217c7f132e tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:33:17.737672 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-05847ae1-e632-47a1-b0b5-c9217c7f132e tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:33:17.746932 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-05847ae1-e632-47a1-b0b5-c9217c7f132e tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:33:17.748515 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-05847ae1-e632-47a1-b0b5-c9217c7f132e tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:33:17.749675 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-05847ae1-e632-47a1-b0b5-c9217c7f132e tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] 10.222.0.46 "GET /compute/v2.1/servers/2e3bce83-6dff-479d-a54c-8f660fbbcdc5" status: 200 len: 1809 microversion: 2.20 time: 0.180115 Aug 04 05:33:17.750221 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 434/857] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Aug 4 05:33:17 2022] GET /compute/v2.1/servers/2e3bce83-6dff-479d-a54c-8f660fbbcdc5 => generated 1809 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 05:33:18.772978 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-725b6451-8d2c-4e04-a38c-3dbde7f6f835 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:33:18.773672 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-725b6451-8d2c-4e04-a38c-3dbde7f6f835 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] [instance: 2e3bce83-6dff-479d-a54c-8f660fbbcdc5] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:33:18.781307 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-725b6451-8d2c-4e04-a38c-3dbde7f6f835 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:33:18.781830 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-725b6451-8d2c-4e04-a38c-3dbde7f6f835 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:33:18.782753 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-725b6451-8d2c-4e04-a38c-3dbde7f6f835 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:33:18.783289 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-725b6451-8d2c-4e04-a38c-3dbde7f6f835 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:33:18.929362 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-725b6451-8d2c-4e04-a38c-3dbde7f6f835 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:33:18.941351 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-725b6451-8d2c-4e04-a38c-3dbde7f6f835 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:33:18.942937 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-725b6451-8d2c-4e04-a38c-3dbde7f6f835 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:33:18.945799 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-725b6451-8d2c-4e04-a38c-3dbde7f6f835 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] 10.222.0.46 "GET /compute/v2.1/servers/2e3bce83-6dff-479d-a54c-8f660fbbcdc5" status: 200 len: 1809 microversion: 2.20 time: 0.175500 Aug 04 05:33:18.950483 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 424/858] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Aug 4 05:33:18 2022] GET /compute/v2.1/servers/2e3bce83-6dff-479d-a54c-8f660fbbcdc5 => generated 1809 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 05:33:19.968708 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-73102626-6f74-4b31-8881-df74c651af6f tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:33:19.969314 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-73102626-6f74-4b31-8881-df74c651af6f tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] [instance: 2e3bce83-6dff-479d-a54c-8f660fbbcdc5] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:33:19.979475 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-73102626-6f74-4b31-8881-df74c651af6f tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:33:19.984015 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-73102626-6f74-4b31-8881-df74c651af6f tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:33:19.984015 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-73102626-6f74-4b31-8881-df74c651af6f tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:33:19.984015 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-73102626-6f74-4b31-8881-df74c651af6f tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:33:20.130646 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-73102626-6f74-4b31-8881-df74c651af6f tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:33:20.139149 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-73102626-6f74-4b31-8881-df74c651af6f tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:33:20.140648 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-73102626-6f74-4b31-8881-df74c651af6f tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:33:20.141991 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-73102626-6f74-4b31-8881-df74c651af6f tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] 10.222.0.46 "GET /compute/v2.1/servers/2e3bce83-6dff-479d-a54c-8f660fbbcdc5" status: 200 len: 1796 microversion: 2.20 time: 0.177035 Aug 04 05:33:20.142590 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 435/859] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Aug 4 05:33:19 2022] GET /compute/v2.1/servers/2e3bce83-6dff-479d-a54c-8f660fbbcdc5 => generated 1796 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 05:33:32.640957 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-e0ea9cf6-ce19-4fb6-9bf8-39c1fb7ef904 tempest-VolumesNegativeTest-91711685 tempest-VolumesNegativeTest-91711685-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1588807762", "imageRef": "4613f7d0-37ca-46ad-bb26-dc4990dd7d6f", "flavorRef": "452"}} {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:33:32.653030 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG dbcounter [-] [118476] Writing DB stats nova_api:SELECT=13 {{(pid=118476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:33:32.654221 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG dbcounter [-] [118476] Writing DB stats nova_cell1:SELECT=78 {{(pid=118476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:33:32.700421 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.network.neutron [None req-e0ea9cf6-ce19-4fb6-9bf8-39c1fb7ef904 tempest-VolumesNegativeTest-91711685 tempest-VolumesNegativeTest-91711685-project] validate_networks() for None {{(pid=118476) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 05:33:32.984818 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.virt.hardware [None req-e0ea9cf6-ce19-4fb6-9bf8-39c1fb7ef904 tempest-VolumesNegativeTest-91711685 tempest-VolumesNegativeTest-91711685-project] Flavor limits 0:0:0 {{(pid=118476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 05:33:32.985304 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.virt.hardware [None req-e0ea9cf6-ce19-4fb6-9bf8-39c1fb7ef904 tempest-VolumesNegativeTest-91711685 tempest-VolumesNegativeTest-91711685-project] Image limits 0:0:0 {{(pid=118476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 05:33:32.985784 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.virt.hardware [None req-e0ea9cf6-ce19-4fb6-9bf8-39c1fb7ef904 tempest-VolumesNegativeTest-91711685 tempest-VolumesNegativeTest-91711685-project] Flavor pref 0:0:0 {{(pid=118476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 05:33:32.986254 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.virt.hardware [None req-e0ea9cf6-ce19-4fb6-9bf8-39c1fb7ef904 tempest-VolumesNegativeTest-91711685 tempest-VolumesNegativeTest-91711685-project] Image pref 0:0:0 {{(pid=118476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 05:33:32.986715 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.virt.hardware [None req-e0ea9cf6-ce19-4fb6-9bf8-39c1fb7ef904 tempest-VolumesNegativeTest-91711685 tempest-VolumesNegativeTest-91711685-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 05:33:32.995901 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-e0ea9cf6-ce19-4fb6-9bf8-39c1fb7ef904 tempest-VolumesNegativeTest-91711685 tempest-VolumesNegativeTest-91711685-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:33:32.996349 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-e0ea9cf6-ce19-4fb6-9bf8-39c1fb7ef904 tempest-VolumesNegativeTest-91711685 tempest-VolumesNegativeTest-91711685-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:33:32.997149 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-e0ea9cf6-ce19-4fb6-9bf8-39c1fb7ef904 tempest-VolumesNegativeTest-91711685 tempest-VolumesNegativeTest-91711685-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:33:32.997587 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-e0ea9cf6-ce19-4fb6-9bf8-39c1fb7ef904 tempest-VolumesNegativeTest-91711685 tempest-VolumesNegativeTest-91711685-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:33:33.014091 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.quota [None req-e0ea9cf6-ce19-4fb6-9bf8-39c1fb7ef904 tempest-VolumesNegativeTest-91711685 tempest-VolumesNegativeTest-91711685-project] Getting quotas for project 2f6bda6801cf4d18abdeab209ec0037d. Resources: {'instances', 'cores', 'ram'} {{(pid=118476) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 05:33:33.018721 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.quota [None req-e0ea9cf6-ce19-4fb6-9bf8-39c1fb7ef904 tempest-VolumesNegativeTest-91711685 tempest-VolumesNegativeTest-91711685-project] Getting quotas for user f56d0ab5cf9d4c85841b57f4fe91107b and project 2f6bda6801cf4d18abdeab209ec0037d. Resources: {'instances', 'cores', 'ram'} {{(pid=118476) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 05:33:33.030008 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-e0ea9cf6-ce19-4fb6-9bf8-39c1fb7ef904 tempest-VolumesNegativeTest-91711685 tempest-VolumesNegativeTest-91711685-project] Going to run 1 instances... {{(pid=118476) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 05:33:33.032313 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-e0ea9cf6-ce19-4fb6-9bf8-39c1fb7ef904 tempest-VolumesNegativeTest-91711685 tempest-VolumesNegativeTest-91711685-project] [instance: a010d7de-87af-4508-a13b-d307257e1e46] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4613f7d0-37ca-46ad-bb26-dc4990dd7d6f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118476) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 05:33:33.176249 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-e0ea9cf6-ce19-4fb6-9bf8-39c1fb7ef904 tempest-VolumesNegativeTest-91711685 tempest-VolumesNegativeTest-91711685-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.539106 Aug 04 05:33:33.177224 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 425/860] 10.222.0.46 () {60 vars in 1147 bytes} [Thu Aug 4 05:33:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 540 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 05:33:33.188494 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-859911a1-6af4-45b5-86da-4b1214057f7a tempest-VolumesNegativeTest-91711685 tempest-VolumesNegativeTest-91711685-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:33:33.191343 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-859911a1-6af4-45b5-86da-4b1214057f7a tempest-VolumesNegativeTest-91711685 tempest-VolumesNegativeTest-91711685-project] [instance: a010d7de-87af-4508-a13b-d307257e1e46] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:33:33.198413 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG dbcounter [-] [118477] Writing DB stats nova_api:SELECT=13 {{(pid=118477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:33:33.199137 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG dbcounter [-] [118477] Writing DB stats nova_cell1:SELECT=66 {{(pid=118477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:33:33.251019 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-859911a1-6af4-45b5-86da-4b1214057f7a tempest-VolumesNegativeTest-91711685 tempest-VolumesNegativeTest-91711685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56d0ab5cf9d4c85841b57f4fe91107b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f6bda6801cf4d18abdeab209ec0037d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:33:33.258925 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-859911a1-6af4-45b5-86da-4b1214057f7a tempest-VolumesNegativeTest-91711685 tempest-VolumesNegativeTest-91711685-project] 10.222.0.46 "GET /compute/v2.1/servers/a010d7de-87af-4508-a13b-d307257e1e46" status: 200 len: 1215 microversion: 2.1 time: 0.074897 Aug 04 05:33:33.259641 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 436/861] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:33:33 2022] GET /compute/v2.1/servers/a010d7de-87af-4508-a13b-d307257e1e46 => generated 1215 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:33:34.281139 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-ff70c5d1-44a2-4265-b2af-27f2d619cd3c tempest-VolumesNegativeTest-91711685 tempest-VolumesNegativeTest-91711685-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:33:34.284217 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-ff70c5d1-44a2-4265-b2af-27f2d619cd3c tempest-VolumesNegativeTest-91711685 tempest-VolumesNegativeTest-91711685-project] [instance: a010d7de-87af-4508-a13b-d307257e1e46] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:33:34.337374 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-ff70c5d1-44a2-4265-b2af-27f2d619cd3c tempest-VolumesNegativeTest-91711685 tempest-VolumesNegativeTest-91711685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56d0ab5cf9d4c85841b57f4fe91107b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f6bda6801cf4d18abdeab209ec0037d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:33:34.346939 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-ff70c5d1-44a2-4265-b2af-27f2d619cd3c tempest-VolumesNegativeTest-91711685 tempest-VolumesNegativeTest-91711685-project] 10.222.0.46 "GET /compute/v2.1/servers/a010d7de-87af-4508-a13b-d307257e1e46" status: 200 len: 1215 microversion: 2.1 time: 0.069824 Aug 04 05:33:34.347823 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 426/862] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:33:34 2022] GET /compute/v2.1/servers/a010d7de-87af-4508-a13b-d307257e1e46 => generated 1215 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:33:35.377803 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-4e3084f4-d315-4904-aa39-16e7c2dc9799 tempest-VolumesNegativeTest-91711685 tempest-VolumesNegativeTest-91711685-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:33:35.377803 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-4e3084f4-d315-4904-aa39-16e7c2dc9799 tempest-VolumesNegativeTest-91711685 tempest-VolumesNegativeTest-91711685-project] [instance: a010d7de-87af-4508-a13b-d307257e1e46] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:33:35.426270 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-4e3084f4-d315-4904-aa39-16e7c2dc9799 tempest-VolumesNegativeTest-91711685 tempest-VolumesNegativeTest-91711685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56d0ab5cf9d4c85841b57f4fe91107b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f6bda6801cf4d18abdeab209ec0037d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:33:35.433667 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-4e3084f4-d315-4904-aa39-16e7c2dc9799 tempest-VolumesNegativeTest-91711685 tempest-VolumesNegativeTest-91711685-project] 10.222.0.46 "GET /compute/v2.1/servers/a010d7de-87af-4508-a13b-d307257e1e46" status: 200 len: 1215 microversion: 2.1 time: 0.065652 Aug 04 05:33:35.434225 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 437/863] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:33:35 2022] GET /compute/v2.1/servers/a010d7de-87af-4508-a13b-d307257e1e46 => generated 1215 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:33:36.456035 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-034f2946-8dff-40b8-8174-b9936477c7ff tempest-VolumesNegativeTest-91711685 tempest-VolumesNegativeTest-91711685-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:33:36.456624 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-034f2946-8dff-40b8-8174-b9936477c7ff tempest-VolumesNegativeTest-91711685 tempest-VolumesNegativeTest-91711685-project] [instance: a010d7de-87af-4508-a13b-d307257e1e46] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:33:36.468827 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 05:33:36.474199 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: Thu Aug 4 05:33:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 05:33:36.510380 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-034f2946-8dff-40b8-8174-b9936477c7ff tempest-VolumesNegativeTest-91711685 tempest-VolumesNegativeTest-91711685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56d0ab5cf9d4c85841b57f4fe91107b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f6bda6801cf4d18abdeab209ec0037d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:33:36.517062 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-034f2946-8dff-40b8-8174-b9936477c7ff tempest-VolumesNegativeTest-91711685 tempest-VolumesNegativeTest-91711685-project] 10.222.0.46 "GET /compute/v2.1/servers/a010d7de-87af-4508-a13b-d307257e1e46" status: 200 len: 1215 microversion: 2.1 time: 0.065644 Aug 04 05:33:36.517615 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 427/864] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:33:36 2022] GET /compute/v2.1/servers/a010d7de-87af-4508-a13b-d307257e1e46 => generated 1215 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:33:37.539348 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-bd4b290e-6209-4263-a1e2-19c31d15c3df tempest-VolumesNegativeTest-91711685 tempest-VolumesNegativeTest-91711685-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:33:37.539898 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-bd4b290e-6209-4263-a1e2-19c31d15c3df tempest-VolumesNegativeTest-91711685 tempest-VolumesNegativeTest-91711685-project] [instance: a010d7de-87af-4508-a13b-d307257e1e46] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:33:37.546767 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-bd4b290e-6209-4263-a1e2-19c31d15c3df tempest-VolumesNegativeTest-91711685 tempest-VolumesNegativeTest-91711685-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:33:37.547217 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-bd4b290e-6209-4263-a1e2-19c31d15c3df tempest-VolumesNegativeTest-91711685 tempest-VolumesNegativeTest-91711685-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:33:37.547975 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-bd4b290e-6209-4263-a1e2-19c31d15c3df tempest-VolumesNegativeTest-91711685 tempest-VolumesNegativeTest-91711685-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:33:37.548412 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-bd4b290e-6209-4263-a1e2-19c31d15c3df tempest-VolumesNegativeTest-91711685 tempest-VolumesNegativeTest-91711685-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:33:37.609255 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-bd4b290e-6209-4263-a1e2-19c31d15c3df tempest-VolumesNegativeTest-91711685 tempest-VolumesNegativeTest-91711685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56d0ab5cf9d4c85841b57f4fe91107b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f6bda6801cf4d18abdeab209ec0037d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:33:37.616675 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-bd4b290e-6209-4263-a1e2-19c31d15c3df tempest-VolumesNegativeTest-91711685 tempest-VolumesNegativeTest-91711685-project] 10.222.0.46 "GET /compute/v2.1/servers/a010d7de-87af-4508-a13b-d307257e1e46" status: 200 len: 1219 microversion: 2.1 time: 0.081965 Aug 04 05:33:37.617368 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 438/865] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:33:37 2022] GET /compute/v2.1/servers/a010d7de-87af-4508-a13b-d307257e1e46 => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:33:38.637523 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-f211b9ac-1648-4381-a2c9-3bda4ab241ed tempest-VolumesNegativeTest-91711685 tempest-VolumesNegativeTest-91711685-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:33:38.638125 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-f211b9ac-1648-4381-a2c9-3bda4ab241ed tempest-VolumesNegativeTest-91711685 tempest-VolumesNegativeTest-91711685-project] [instance: a010d7de-87af-4508-a13b-d307257e1e46] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:33:38.645169 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-f211b9ac-1648-4381-a2c9-3bda4ab241ed tempest-VolumesNegativeTest-91711685 tempest-VolumesNegativeTest-91711685-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:33:38.645618 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-f211b9ac-1648-4381-a2c9-3bda4ab241ed tempest-VolumesNegativeTest-91711685 tempest-VolumesNegativeTest-91711685-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:33:38.646394 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-f211b9ac-1648-4381-a2c9-3bda4ab241ed tempest-VolumesNegativeTest-91711685 tempest-VolumesNegativeTest-91711685-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:33:38.647371 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-f211b9ac-1648-4381-a2c9-3bda4ab241ed tempest-VolumesNegativeTest-91711685 tempest-VolumesNegativeTest-91711685-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:33:38.707790 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-f211b9ac-1648-4381-a2c9-3bda4ab241ed tempest-VolumesNegativeTest-91711685 tempest-VolumesNegativeTest-91711685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56d0ab5cf9d4c85841b57f4fe91107b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f6bda6801cf4d18abdeab209ec0037d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:33:38.715883 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-f211b9ac-1648-4381-a2c9-3bda4ab241ed tempest-VolumesNegativeTest-91711685 tempest-VolumesNegativeTest-91711685-project] 10.222.0.46 "GET /compute/v2.1/servers/a010d7de-87af-4508-a13b-d307257e1e46" status: 200 len: 1219 microversion: 2.1 time: 0.082213 Aug 04 05:33:38.716443 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 428/866] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:33:38 2022] GET /compute/v2.1/servers/a010d7de-87af-4508-a13b-d307257e1e46 => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:33:39.737546 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-2141b9ce-b873-4cfe-88b8-9f646668e42b tempest-VolumesNegativeTest-91711685 tempest-VolumesNegativeTest-91711685-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:33:39.738147 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-2141b9ce-b873-4cfe-88b8-9f646668e42b tempest-VolumesNegativeTest-91711685 tempest-VolumesNegativeTest-91711685-project] [instance: a010d7de-87af-4508-a13b-d307257e1e46] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:33:39.745084 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-2141b9ce-b873-4cfe-88b8-9f646668e42b tempest-VolumesNegativeTest-91711685 tempest-VolumesNegativeTest-91711685-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:33:39.745520 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-2141b9ce-b873-4cfe-88b8-9f646668e42b tempest-VolumesNegativeTest-91711685 tempest-VolumesNegativeTest-91711685-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:33:39.746263 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-2141b9ce-b873-4cfe-88b8-9f646668e42b tempest-VolumesNegativeTest-91711685 tempest-VolumesNegativeTest-91711685-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:33:39.746717 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-2141b9ce-b873-4cfe-88b8-9f646668e42b tempest-VolumesNegativeTest-91711685 tempest-VolumesNegativeTest-91711685-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:33:39.808211 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-2141b9ce-b873-4cfe-88b8-9f646668e42b tempest-VolumesNegativeTest-91711685 tempest-VolumesNegativeTest-91711685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56d0ab5cf9d4c85841b57f4fe91107b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f6bda6801cf4d18abdeab209ec0037d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:33:39.815787 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-2141b9ce-b873-4cfe-88b8-9f646668e42b tempest-VolumesNegativeTest-91711685 tempest-VolumesNegativeTest-91711685-project] 10.222.0.46 "GET /compute/v2.1/servers/a010d7de-87af-4508-a13b-d307257e1e46" status: 200 len: 1219 microversion: 2.1 time: 0.082084 Aug 04 05:33:39.816356 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 439/867] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:33:39 2022] GET /compute/v2.1/servers/a010d7de-87af-4508-a13b-d307257e1e46 => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:33:40.837719 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-3b32bcfd-647f-464e-aa19-3b4c438e8c8e tempest-VolumesNegativeTest-91711685 tempest-VolumesNegativeTest-91711685-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:33:40.838391 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-3b32bcfd-647f-464e-aa19-3b4c438e8c8e tempest-VolumesNegativeTest-91711685 tempest-VolumesNegativeTest-91711685-project] [instance: a010d7de-87af-4508-a13b-d307257e1e46] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:33:40.844869 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-3b32bcfd-647f-464e-aa19-3b4c438e8c8e tempest-VolumesNegativeTest-91711685 tempest-VolumesNegativeTest-91711685-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:33:40.845311 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-3b32bcfd-647f-464e-aa19-3b4c438e8c8e tempest-VolumesNegativeTest-91711685 tempest-VolumesNegativeTest-91711685-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:33:40.846080 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-3b32bcfd-647f-464e-aa19-3b4c438e8c8e tempest-VolumesNegativeTest-91711685 tempest-VolumesNegativeTest-91711685-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:33:40.846533 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-3b32bcfd-647f-464e-aa19-3b4c438e8c8e tempest-VolumesNegativeTest-91711685 tempest-VolumesNegativeTest-91711685-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:33:40.914410 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-3b32bcfd-647f-464e-aa19-3b4c438e8c8e tempest-VolumesNegativeTest-91711685 tempest-VolumesNegativeTest-91711685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56d0ab5cf9d4c85841b57f4fe91107b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f6bda6801cf4d18abdeab209ec0037d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:33:40.921939 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-3b32bcfd-647f-464e-aa19-3b4c438e8c8e tempest-VolumesNegativeTest-91711685 tempest-VolumesNegativeTest-91711685-project] 10.222.0.46 "GET /compute/v2.1/servers/a010d7de-87af-4508-a13b-d307257e1e46" status: 200 len: 1267 microversion: 2.1 time: 0.088746 Aug 04 05:33:40.922532 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 429/868] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:33:40 2022] GET /compute/v2.1/servers/a010d7de-87af-4508-a13b-d307257e1e46 => generated 1267 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:33:41.945063 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-456862e6-8b55-4c7b-a90a-ed56cd24d901 tempest-VolumesNegativeTest-91711685 tempest-VolumesNegativeTest-91711685-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:33:41.945740 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-456862e6-8b55-4c7b-a90a-ed56cd24d901 tempest-VolumesNegativeTest-91711685 tempest-VolumesNegativeTest-91711685-project] [instance: a010d7de-87af-4508-a13b-d307257e1e46] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:33:41.952430 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-456862e6-8b55-4c7b-a90a-ed56cd24d901 tempest-VolumesNegativeTest-91711685 tempest-VolumesNegativeTest-91711685-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:33:41.952869 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-456862e6-8b55-4c7b-a90a-ed56cd24d901 tempest-VolumesNegativeTest-91711685 tempest-VolumesNegativeTest-91711685-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:33:41.953630 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-456862e6-8b55-4c7b-a90a-ed56cd24d901 tempest-VolumesNegativeTest-91711685 tempest-VolumesNegativeTest-91711685-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:33:41.954060 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-456862e6-8b55-4c7b-a90a-ed56cd24d901 tempest-VolumesNegativeTest-91711685 tempest-VolumesNegativeTest-91711685-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:33:42.024221 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-456862e6-8b55-4c7b-a90a-ed56cd24d901 tempest-VolumesNegativeTest-91711685 tempest-VolumesNegativeTest-91711685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56d0ab5cf9d4c85841b57f4fe91107b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f6bda6801cf4d18abdeab209ec0037d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:33:42.031926 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-456862e6-8b55-4c7b-a90a-ed56cd24d901 tempest-VolumesNegativeTest-91711685 tempest-VolumesNegativeTest-91711685-project] 10.222.0.46 "GET /compute/v2.1/servers/a010d7de-87af-4508-a13b-d307257e1e46" status: 200 len: 1273 microversion: 2.1 time: 0.091420 Aug 04 05:33:42.032515 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 440/869] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:33:41 2022] GET /compute/v2.1/servers/a010d7de-87af-4508-a13b-d307257e1e46 => generated 1273 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:33:43.052660 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-413b71bc-1acd-43b5-bd83-451c2cdd1a25 tempest-VolumesNegativeTest-91711685 tempest-VolumesNegativeTest-91711685-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:33:43.053764 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-413b71bc-1acd-43b5-bd83-451c2cdd1a25 tempest-VolumesNegativeTest-91711685 tempest-VolumesNegativeTest-91711685-project] [instance: a010d7de-87af-4508-a13b-d307257e1e46] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:33:43.056069 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG dbcounter [-] [118476] Writing DB stats nova_cell0:SELECT=2 {{(pid=118476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:33:43.060989 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-413b71bc-1acd-43b5-bd83-451c2cdd1a25 tempest-VolumesNegativeTest-91711685 tempest-VolumesNegativeTest-91711685-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:33:43.061429 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-413b71bc-1acd-43b5-bd83-451c2cdd1a25 tempest-VolumesNegativeTest-91711685 tempest-VolumesNegativeTest-91711685-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:33:43.062178 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-413b71bc-1acd-43b5-bd83-451c2cdd1a25 tempest-VolumesNegativeTest-91711685 tempest-VolumesNegativeTest-91711685-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:33:43.062634 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-413b71bc-1acd-43b5-bd83-451c2cdd1a25 tempest-VolumesNegativeTest-91711685 tempest-VolumesNegativeTest-91711685-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:33:43.200773 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-413b71bc-1acd-43b5-bd83-451c2cdd1a25 tempest-VolumesNegativeTest-91711685 tempest-VolumesNegativeTest-91711685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56d0ab5cf9d4c85841b57f4fe91107b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f6bda6801cf4d18abdeab209ec0037d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:33:43.208131 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-413b71bc-1acd-43b5-bd83-451c2cdd1a25 tempest-VolumesNegativeTest-91711685 tempest-VolumesNegativeTest-91711685-project] 10.222.0.46 "GET /compute/v2.1/servers/a010d7de-87af-4508-a13b-d307257e1e46" status: 200 len: 1315 microversion: 2.1 time: 0.159453 Aug 04 05:33:43.208687 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 430/870] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:33:43 2022] GET /compute/v2.1/servers/a010d7de-87af-4508-a13b-d307257e1e46 => generated 1315 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:33:44.229497 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-d6f66ecd-41ff-4e22-8f21-357485e47b4d tempest-VolumesNegativeTest-91711685 tempest-VolumesNegativeTest-91711685-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:33:44.230116 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-d6f66ecd-41ff-4e22-8f21-357485e47b4d tempest-VolumesNegativeTest-91711685 tempest-VolumesNegativeTest-91711685-project] [instance: a010d7de-87af-4508-a13b-d307257e1e46] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:33:44.236885 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-d6f66ecd-41ff-4e22-8f21-357485e47b4d tempest-VolumesNegativeTest-91711685 tempest-VolumesNegativeTest-91711685-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:33:44.237322 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-d6f66ecd-41ff-4e22-8f21-357485e47b4d tempest-VolumesNegativeTest-91711685 tempest-VolumesNegativeTest-91711685-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:33:44.238075 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-d6f66ecd-41ff-4e22-8f21-357485e47b4d tempest-VolumesNegativeTest-91711685 tempest-VolumesNegativeTest-91711685-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:33:44.238545 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-d6f66ecd-41ff-4e22-8f21-357485e47b4d tempest-VolumesNegativeTest-91711685 tempest-VolumesNegativeTest-91711685-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:33:44.367998 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-d6f66ecd-41ff-4e22-8f21-357485e47b4d tempest-VolumesNegativeTest-91711685 tempest-VolumesNegativeTest-91711685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56d0ab5cf9d4c85841b57f4fe91107b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f6bda6801cf4d18abdeab209ec0037d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:33:44.375675 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-d6f66ecd-41ff-4e22-8f21-357485e47b4d tempest-VolumesNegativeTest-91711685 tempest-VolumesNegativeTest-91711685-project] 10.222.0.46 "GET /compute/v2.1/servers/a010d7de-87af-4508-a13b-d307257e1e46" status: 200 len: 1315 microversion: 2.1 time: 0.150218 Aug 04 05:33:44.376298 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 441/871] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:33:44 2022] GET /compute/v2.1/servers/a010d7de-87af-4508-a13b-d307257e1e46 => generated 1315 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:33:45.396006 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-cbd70d86-5966-45d2-8a31-9a68dbcc18fa tempest-VolumesNegativeTest-91711685 tempest-VolumesNegativeTest-91711685-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:33:45.397149 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-cbd70d86-5966-45d2-8a31-9a68dbcc18fa tempest-VolumesNegativeTest-91711685 tempest-VolumesNegativeTest-91711685-project] [instance: a010d7de-87af-4508-a13b-d307257e1e46] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:33:45.403915 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-cbd70d86-5966-45d2-8a31-9a68dbcc18fa tempest-VolumesNegativeTest-91711685 tempest-VolumesNegativeTest-91711685-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:33:45.404369 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-cbd70d86-5966-45d2-8a31-9a68dbcc18fa tempest-VolumesNegativeTest-91711685 tempest-VolumesNegativeTest-91711685-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:33:45.405178 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-cbd70d86-5966-45d2-8a31-9a68dbcc18fa tempest-VolumesNegativeTest-91711685 tempest-VolumesNegativeTest-91711685-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:33:45.405643 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-cbd70d86-5966-45d2-8a31-9a68dbcc18fa tempest-VolumesNegativeTest-91711685 tempest-VolumesNegativeTest-91711685-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:33:45.425177 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [req-a52e06bd-949d-436a-a569-91e02c321239 req-0d23a6a0-1150-466c-bcb8-45a84156abd5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a010d7de-87af-4508-a13b-d307257e1e46", "tag": "0702b2d5-37dc-40b2-b1a3-437332ef2b1e"}]} {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:33:45.434613 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG dbcounter [-] [118477] Writing DB stats nova_cell0:SELECT=4 {{(pid=118477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:33:45.440393 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [req-a52e06bd-949d-436a-a569-91e02c321239 req-0d23a6a0-1150-466c-bcb8-45a84156abd5 service nova] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:33:45.440393 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [req-a52e06bd-949d-436a-a569-91e02c321239 req-0d23a6a0-1150-466c-bcb8-45a84156abd5 service nova] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:33:45.450643 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.compute.server_external_events [req-a52e06bd-949d-436a-a569-91e02c321239 req-0d23a6a0-1150-466c-bcb8-45a84156abd5 service nova] Creating event network-changed:0702b2d5-37dc-40b2-b1a3-437332ef2b1e for instance a010d7de-87af-4508-a13b-d307257e1e46 on hv-cinder-85207 Aug 04 05:33:45.455693 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [req-a52e06bd-949d-436a-a569-91e02c321239 req-0d23a6a0-1150-466c-bcb8-45a84156abd5 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034524 Aug 04 05:33:45.456401 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 442/872] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Aug 4 05:33:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 05:33:45.618285 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-cbd70d86-5966-45d2-8a31-9a68dbcc18fa tempest-VolumesNegativeTest-91711685 tempest-VolumesNegativeTest-91711685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56d0ab5cf9d4c85841b57f4fe91107b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f6bda6801cf4d18abdeab209ec0037d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:33:45.625918 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-cbd70d86-5966-45d2-8a31-9a68dbcc18fa tempest-VolumesNegativeTest-91711685 tempest-VolumesNegativeTest-91711685-project] 10.222.0.46 "GET /compute/v2.1/servers/a010d7de-87af-4508-a13b-d307257e1e46" status: 200 len: 1315 microversion: 2.1 time: 0.233909 Aug 04 05:33:45.626520 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 431/873] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:33:45 2022] GET /compute/v2.1/servers/a010d7de-87af-4508-a13b-d307257e1e46 => generated 1315 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:33:46.650132 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-e5664306-702f-40b4-9c8e-88c787165a7f tempest-VolumesNegativeTest-91711685 tempest-VolumesNegativeTest-91711685-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:33:46.650912 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-e5664306-702f-40b4-9c8e-88c787165a7f tempest-VolumesNegativeTest-91711685 tempest-VolumesNegativeTest-91711685-project] [instance: a010d7de-87af-4508-a13b-d307257e1e46] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:33:46.657564 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-e5664306-702f-40b4-9c8e-88c787165a7f tempest-VolumesNegativeTest-91711685 tempest-VolumesNegativeTest-91711685-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:33:46.658019 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-e5664306-702f-40b4-9c8e-88c787165a7f tempest-VolumesNegativeTest-91711685 tempest-VolumesNegativeTest-91711685-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:33:46.658836 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-e5664306-702f-40b4-9c8e-88c787165a7f tempest-VolumesNegativeTest-91711685 tempest-VolumesNegativeTest-91711685-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:33:46.659272 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-e5664306-702f-40b4-9c8e-88c787165a7f tempest-VolumesNegativeTest-91711685 tempest-VolumesNegativeTest-91711685-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:33:46.798243 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-e5664306-702f-40b4-9c8e-88c787165a7f tempest-VolumesNegativeTest-91711685 tempest-VolumesNegativeTest-91711685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56d0ab5cf9d4c85841b57f4fe91107b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f6bda6801cf4d18abdeab209ec0037d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:33:46.807080 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-e5664306-702f-40b4-9c8e-88c787165a7f tempest-VolumesNegativeTest-91711685 tempest-VolumesNegativeTest-91711685-project] 10.222.0.46 "GET /compute/v2.1/servers/a010d7de-87af-4508-a13b-d307257e1e46" status: 200 len: 1315 microversion: 2.1 time: 0.162174 Aug 04 05:33:46.807646 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 443/874] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:33:46 2022] GET /compute/v2.1/servers/a010d7de-87af-4508-a13b-d307257e1e46 => generated 1315 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:33:47.827606 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-4027a92e-3cbf-4a7e-9b2e-f4b487960d29 tempest-VolumesNegativeTest-91711685 tempest-VolumesNegativeTest-91711685-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:33:47.828214 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-4027a92e-3cbf-4a7e-9b2e-f4b487960d29 tempest-VolumesNegativeTest-91711685 tempest-VolumesNegativeTest-91711685-project] [instance: a010d7de-87af-4508-a13b-d307257e1e46] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:33:47.830498 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG dbcounter [-] [118476] Writing DB stats nova_cell0:SELECT=10 {{(pid=118476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:33:47.835277 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-4027a92e-3cbf-4a7e-9b2e-f4b487960d29 tempest-VolumesNegativeTest-91711685 tempest-VolumesNegativeTest-91711685-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:33:47.835723 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-4027a92e-3cbf-4a7e-9b2e-f4b487960d29 tempest-VolumesNegativeTest-91711685 tempest-VolumesNegativeTest-91711685-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:33:47.836476 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-4027a92e-3cbf-4a7e-9b2e-f4b487960d29 tempest-VolumesNegativeTest-91711685 tempest-VolumesNegativeTest-91711685-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:33:47.837417 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-4027a92e-3cbf-4a7e-9b2e-f4b487960d29 tempest-VolumesNegativeTest-91711685 tempest-VolumesNegativeTest-91711685-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:33:47.968919 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-4027a92e-3cbf-4a7e-9b2e-f4b487960d29 tempest-VolumesNegativeTest-91711685 tempest-VolumesNegativeTest-91711685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56d0ab5cf9d4c85841b57f4fe91107b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f6bda6801cf4d18abdeab209ec0037d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:33:47.978833 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-4027a92e-3cbf-4a7e-9b2e-f4b487960d29 tempest-VolumesNegativeTest-91711685 tempest-VolumesNegativeTest-91711685-project] 10.222.0.46 "GET /compute/v2.1/servers/a010d7de-87af-4508-a13b-d307257e1e46" status: 200 len: 1315 microversion: 2.1 time: 0.152541 Aug 04 05:33:47.978833 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 432/875] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:33:47 2022] GET /compute/v2.1/servers/a010d7de-87af-4508-a13b-d307257e1e46 => generated 1315 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:33:48.999424 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-ede97013-1f69-4f14-8758-043fe0b1b318 tempest-VolumesNegativeTest-91711685 tempest-VolumesNegativeTest-91711685-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:33:49.000124 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-ede97013-1f69-4f14-8758-043fe0b1b318 tempest-VolumesNegativeTest-91711685 tempest-VolumesNegativeTest-91711685-project] [instance: a010d7de-87af-4508-a13b-d307257e1e46] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:33:49.007027 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-ede97013-1f69-4f14-8758-043fe0b1b318 tempest-VolumesNegativeTest-91711685 tempest-VolumesNegativeTest-91711685-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:33:49.007465 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-ede97013-1f69-4f14-8758-043fe0b1b318 tempest-VolumesNegativeTest-91711685 tempest-VolumesNegativeTest-91711685-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:33:49.008264 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-ede97013-1f69-4f14-8758-043fe0b1b318 tempest-VolumesNegativeTest-91711685 tempest-VolumesNegativeTest-91711685-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:33:49.008687 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-ede97013-1f69-4f14-8758-043fe0b1b318 tempest-VolumesNegativeTest-91711685 tempest-VolumesNegativeTest-91711685-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:33:49.145632 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-ede97013-1f69-4f14-8758-043fe0b1b318 tempest-VolumesNegativeTest-91711685 tempest-VolumesNegativeTest-91711685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56d0ab5cf9d4c85841b57f4fe91107b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f6bda6801cf4d18abdeab209ec0037d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:33:49.154434 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-ede97013-1f69-4f14-8758-043fe0b1b318 tempest-VolumesNegativeTest-91711685 tempest-VolumesNegativeTest-91711685-project] 10.222.0.46 "GET /compute/v2.1/servers/a010d7de-87af-4508-a13b-d307257e1e46" status: 200 len: 1315 microversion: 2.1 time: 0.161206 Aug 04 05:33:49.155012 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 444/876] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:33:48 2022] GET /compute/v2.1/servers/a010d7de-87af-4508-a13b-d307257e1e46 => generated 1315 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:33:50.176825 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-7637e071-f993-400e-87ef-eb62cbb061db tempest-VolumesNegativeTest-91711685 tempest-VolumesNegativeTest-91711685-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:33:50.177444 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-7637e071-f993-400e-87ef-eb62cbb061db tempest-VolumesNegativeTest-91711685 tempest-VolumesNegativeTest-91711685-project] [instance: a010d7de-87af-4508-a13b-d307257e1e46] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:33:50.184654 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-7637e071-f993-400e-87ef-eb62cbb061db tempest-VolumesNegativeTest-91711685 tempest-VolumesNegativeTest-91711685-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:33:50.185105 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-7637e071-f993-400e-87ef-eb62cbb061db tempest-VolumesNegativeTest-91711685 tempest-VolumesNegativeTest-91711685-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:33:50.185945 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-7637e071-f993-400e-87ef-eb62cbb061db tempest-VolumesNegativeTest-91711685 tempest-VolumesNegativeTest-91711685-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:33:50.186383 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-7637e071-f993-400e-87ef-eb62cbb061db tempest-VolumesNegativeTest-91711685 tempest-VolumesNegativeTest-91711685-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:33:50.319791 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-7637e071-f993-400e-87ef-eb62cbb061db tempest-VolumesNegativeTest-91711685 tempest-VolumesNegativeTest-91711685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56d0ab5cf9d4c85841b57f4fe91107b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f6bda6801cf4d18abdeab209ec0037d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:33:50.327795 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-7637e071-f993-400e-87ef-eb62cbb061db tempest-VolumesNegativeTest-91711685 tempest-VolumesNegativeTest-91711685-project] 10.222.0.46 "GET /compute/v2.1/servers/a010d7de-87af-4508-a13b-d307257e1e46" status: 200 len: 1315 microversion: 2.1 time: 0.154982 Aug 04 05:33:50.328370 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 433/877] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:33:50 2022] GET /compute/v2.1/servers/a010d7de-87af-4508-a13b-d307257e1e46 => generated 1315 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:33:51.025158 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [req-39805a6d-b6db-471a-847f-1448d6e47e90 req-b6945b2a-2eef-47d6-b472-9a10bb0f3b02 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a010d7de-87af-4508-a13b-d307257e1e46", "name": "network-vif-plugged", "status": "completed", "tag": "0702b2d5-37dc-40b2-b1a3-437332ef2b1e"}]} {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:33:51.043397 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [req-39805a6d-b6db-471a-847f-1448d6e47e90 req-b6945b2a-2eef-47d6-b472-9a10bb0f3b02 service nova] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:33:51.043910 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [req-39805a6d-b6db-471a-847f-1448d6e47e90 req-b6945b2a-2eef-47d6-b472-9a10bb0f3b02 service nova] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:33:51.059139 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.compute.server_external_events [req-39805a6d-b6db-471a-847f-1448d6e47e90 req-b6945b2a-2eef-47d6-b472-9a10bb0f3b02 service nova] Creating event network-vif-plugged:0702b2d5-37dc-40b2-b1a3-437332ef2b1e for instance a010d7de-87af-4508-a13b-d307257e1e46 on hv-cinder-85207 Aug 04 05:33:51.064140 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [req-39805a6d-b6db-471a-847f-1448d6e47e90 req-b6945b2a-2eef-47d6-b472-9a10bb0f3b02 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043015 Aug 04 05:33:51.064729 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 445/878] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Aug 4 05:33:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:33:51.349091 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-2d0db101-bd2e-4eff-82c5-dace4e9c862f tempest-VolumesNegativeTest-91711685 tempest-VolumesNegativeTest-91711685-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:33:51.349634 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-2d0db101-bd2e-4eff-82c5-dace4e9c862f tempest-VolumesNegativeTest-91711685 tempest-VolumesNegativeTest-91711685-project] [instance: a010d7de-87af-4508-a13b-d307257e1e46] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:33:51.356668 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-2d0db101-bd2e-4eff-82c5-dace4e9c862f tempest-VolumesNegativeTest-91711685 tempest-VolumesNegativeTest-91711685-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:33:51.357115 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-2d0db101-bd2e-4eff-82c5-dace4e9c862f tempest-VolumesNegativeTest-91711685 tempest-VolumesNegativeTest-91711685-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:33:51.357869 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-2d0db101-bd2e-4eff-82c5-dace4e9c862f tempest-VolumesNegativeTest-91711685 tempest-VolumesNegativeTest-91711685-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:33:51.358302 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-2d0db101-bd2e-4eff-82c5-dace4e9c862f tempest-VolumesNegativeTest-91711685 tempest-VolumesNegativeTest-91711685-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:33:51.485990 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-2d0db101-bd2e-4eff-82c5-dace4e9c862f tempest-VolumesNegativeTest-91711685 tempest-VolumesNegativeTest-91711685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56d0ab5cf9d4c85841b57f4fe91107b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f6bda6801cf4d18abdeab209ec0037d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:33:51.493339 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-2d0db101-bd2e-4eff-82c5-dace4e9c862f tempest-VolumesNegativeTest-91711685 tempest-VolumesNegativeTest-91711685-project] 10.222.0.46 "GET /compute/v2.1/servers/a010d7de-87af-4508-a13b-d307257e1e46" status: 200 len: 1315 microversion: 2.1 time: 0.148234 Aug 04 05:33:51.494450 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 434/879] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:33:51 2022] GET /compute/v2.1/servers/a010d7de-87af-4508-a13b-d307257e1e46 => generated 1315 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:33:52.516092 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-f92d9d32-eea8-4792-877c-4b8701b3d6da tempest-VolumesNegativeTest-91711685 tempest-VolumesNegativeTest-91711685-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:33:52.516783 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-f92d9d32-eea8-4792-877c-4b8701b3d6da tempest-VolumesNegativeTest-91711685 tempest-VolumesNegativeTest-91711685-project] [instance: a010d7de-87af-4508-a13b-d307257e1e46] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:33:52.523018 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-f92d9d32-eea8-4792-877c-4b8701b3d6da tempest-VolumesNegativeTest-91711685 tempest-VolumesNegativeTest-91711685-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:33:52.523458 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-f92d9d32-eea8-4792-877c-4b8701b3d6da tempest-VolumesNegativeTest-91711685 tempest-VolumesNegativeTest-91711685-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:33:52.524201 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-f92d9d32-eea8-4792-877c-4b8701b3d6da tempest-VolumesNegativeTest-91711685 tempest-VolumesNegativeTest-91711685-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:33:52.524626 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-f92d9d32-eea8-4792-877c-4b8701b3d6da tempest-VolumesNegativeTest-91711685 tempest-VolumesNegativeTest-91711685-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:33:52.658829 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-f92d9d32-eea8-4792-877c-4b8701b3d6da tempest-VolumesNegativeTest-91711685 tempest-VolumesNegativeTest-91711685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56d0ab5cf9d4c85841b57f4fe91107b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f6bda6801cf4d18abdeab209ec0037d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:33:52.667485 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-f92d9d32-eea8-4792-877c-4b8701b3d6da tempest-VolumesNegativeTest-91711685 tempest-VolumesNegativeTest-91711685-project] 10.222.0.46 "GET /compute/v2.1/servers/a010d7de-87af-4508-a13b-d307257e1e46" status: 200 len: 1315 microversion: 2.1 time: 0.155914 Aug 04 05:33:52.668123 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 446/880] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:33:52 2022] GET /compute/v2.1/servers/a010d7de-87af-4508-a13b-d307257e1e46 => generated 1315 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:33:53.438745 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-5babfafd-5078-4394-976f-8cc8dcbdf3d9 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:33:53.439509 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-5babfafd-5078-4394-976f-8cc8dcbdf3d9 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] [instance: 2e3bce83-6dff-479d-a54c-8f660fbbcdc5] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:33:53.445499 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-5babfafd-5078-4394-976f-8cc8dcbdf3d9 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:33:53.445937 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-5babfafd-5078-4394-976f-8cc8dcbdf3d9 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:33:53.446718 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-5babfafd-5078-4394-976f-8cc8dcbdf3d9 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:33:53.447148 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-5babfafd-5078-4394-976f-8cc8dcbdf3d9 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:33:53.476596 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-5babfafd-5078-4394-976f-8cc8dcbdf3d9 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] 10.222.0.46 "GET /compute/v2.1/servers/2e3bce83-6dff-479d-a54c-8f660fbbcdc5/os-volume_attachments/0e80b2ba-e41d-47dc-9c57-ea80a9fe6cf2" status: 200 len: 194 microversion: 2.20 time: 0.042234 Aug 04 05:33:53.477212 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 435/881] 10.222.0.46 () {60 vars in 1454 bytes} [Thu Aug 4 05:33:53 2022] GET /compute/v2.1/servers/2e3bce83-6dff-479d-a54c-8f660fbbcdc5/os-volume_attachments/0e80b2ba-e41d-47dc-9c57-ea80a9fe6cf2 => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 05:33:53.548646 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-e4953acb-f977-4512-9d09-b259cb48ba9e tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:33:53.549171 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-e4953acb-f977-4512-9d09-b259cb48ba9e tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] [instance: 2e3bce83-6dff-479d-a54c-8f660fbbcdc5] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:33:53.556113 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-e4953acb-f977-4512-9d09-b259cb48ba9e tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:33:53.556627 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-e4953acb-f977-4512-9d09-b259cb48ba9e tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:33:53.557678 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-e4953acb-f977-4512-9d09-b259cb48ba9e tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:33:53.558328 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-e4953acb-f977-4512-9d09-b259cb48ba9e tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:33:53.646045 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.objects.instance [None req-e4953acb-f977-4512-9d09-b259cb48ba9e tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lazy-loading 'services' on Instance uuid 2e3bce83-6dff-479d-a54c-8f660fbbcdc5 {{(pid=118477) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 05:33:53.690083 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-a3348ad9-55f3-42a7-a2e6-bc74586b9dca tempest-VolumesNegativeTest-91711685 tempest-VolumesNegativeTest-91711685-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:33:53.690747 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-a3348ad9-55f3-42a7-a2e6-bc74586b9dca tempest-VolumesNegativeTest-91711685 tempest-VolumesNegativeTest-91711685-project] [instance: a010d7de-87af-4508-a13b-d307257e1e46] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:33:53.696958 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-a3348ad9-55f3-42a7-a2e6-bc74586b9dca tempest-VolumesNegativeTest-91711685 tempest-VolumesNegativeTest-91711685-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:33:53.697430 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-a3348ad9-55f3-42a7-a2e6-bc74586b9dca tempest-VolumesNegativeTest-91711685 tempest-VolumesNegativeTest-91711685-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:33:53.698833 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-a3348ad9-55f3-42a7-a2e6-bc74586b9dca tempest-VolumesNegativeTest-91711685 tempest-VolumesNegativeTest-91711685-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:33:53.699267 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-a3348ad9-55f3-42a7-a2e6-bc74586b9dca tempest-VolumesNegativeTest-91711685 tempest-VolumesNegativeTest-91711685-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:33:53.840449 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-a3348ad9-55f3-42a7-a2e6-bc74586b9dca tempest-VolumesNegativeTest-91711685 tempest-VolumesNegativeTest-91711685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56d0ab5cf9d4c85841b57f4fe91107b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f6bda6801cf4d18abdeab209ec0037d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:33:53.848228 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-a3348ad9-55f3-42a7-a2e6-bc74586b9dca tempest-VolumesNegativeTest-91711685 tempest-VolumesNegativeTest-91711685-project] 10.222.0.46 "GET /compute/v2.1/servers/a010d7de-87af-4508-a13b-d307257e1e46" status: 200 len: 1315 microversion: 2.1 time: 0.161973 Aug 04 05:33:53.848808 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 436/882] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:33:53 2022] GET /compute/v2.1/servers/a010d7de-87af-4508-a13b-d307257e1e46 => generated 1315 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:33:53.869018 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-e4953acb-f977-4512-9d09-b259cb48ba9e tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] 10.222.0.46 "DELETE /compute/v2.1/servers/2e3bce83-6dff-479d-a54c-8f660fbbcdc5/os-volume_attachments/0e80b2ba-e41d-47dc-9c57-ea80a9fe6cf2" status: 202 len: 0 microversion: 2.20 time: 0.324124 Aug 04 05:33:53.869611 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 447/883] 10.222.0.46 () {60 vars in 1457 bytes} [Thu Aug 4 05:33:53 2022] DELETE /compute/v2.1/servers/2e3bce83-6dff-479d-a54c-8f660fbbcdc5/os-volume_attachments/0e80b2ba-e41d-47dc-9c57-ea80a9fe6cf2 => generated 0 bytes in 325 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 04 05:33:53.878723 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-5c030e1e-0dee-45d5-b872-a30e8d94412a tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:33:53.880954 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-5c030e1e-0dee-45d5-b872-a30e8d94412a tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] [instance: 2e3bce83-6dff-479d-a54c-8f660fbbcdc5] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:33:53.888190 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-5c030e1e-0dee-45d5-b872-a30e8d94412a tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:33:53.888660 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-5c030e1e-0dee-45d5-b872-a30e8d94412a tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:33:53.889412 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-5c030e1e-0dee-45d5-b872-a30e8d94412a tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:33:53.889839 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-5c030e1e-0dee-45d5-b872-a30e8d94412a tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:33:53.922300 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-5c030e1e-0dee-45d5-b872-a30e8d94412a tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] 10.222.0.46 "GET /compute/v2.1/servers/2e3bce83-6dff-479d-a54c-8f660fbbcdc5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047697 Aug 04 05:33:53.922891 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 437/884] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Aug 4 05:33:53 2022] GET /compute/v2.1/servers/2e3bce83-6dff-479d-a54c-8f660fbbcdc5/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 04 05:33:54.871179 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-493e094e-ccd0-4d48-926e-cccfbc62fcd8 tempest-VolumesNegativeTest-91711685 tempest-VolumesNegativeTest-91711685-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:33:54.872337 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-493e094e-ccd0-4d48-926e-cccfbc62fcd8 tempest-VolumesNegativeTest-91711685 tempest-VolumesNegativeTest-91711685-project] [instance: a010d7de-87af-4508-a13b-d307257e1e46] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:33:54.880169 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-493e094e-ccd0-4d48-926e-cccfbc62fcd8 tempest-VolumesNegativeTest-91711685 tempest-VolumesNegativeTest-91711685-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:33:54.883163 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-493e094e-ccd0-4d48-926e-cccfbc62fcd8 tempest-VolumesNegativeTest-91711685 tempest-VolumesNegativeTest-91711685-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:33:54.883163 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-493e094e-ccd0-4d48-926e-cccfbc62fcd8 tempest-VolumesNegativeTest-91711685 tempest-VolumesNegativeTest-91711685-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:33:54.883163 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-493e094e-ccd0-4d48-926e-cccfbc62fcd8 tempest-VolumesNegativeTest-91711685 tempest-VolumesNegativeTest-91711685-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:33:54.935768 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-b3d0f156-0f09-4964-b993-adf803af5ec8 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:33:54.938848 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-b3d0f156-0f09-4964-b993-adf803af5ec8 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] [instance: 2e3bce83-6dff-479d-a54c-8f660fbbcdc5] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:33:54.945927 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-b3d0f156-0f09-4964-b993-adf803af5ec8 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:33:54.946500 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-b3d0f156-0f09-4964-b993-adf803af5ec8 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:33:54.947286 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-b3d0f156-0f09-4964-b993-adf803af5ec8 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:33:54.947823 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-b3d0f156-0f09-4964-b993-adf803af5ec8 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:33:54.981360 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-b3d0f156-0f09-4964-b993-adf803af5ec8 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] 10.222.0.46 "GET /compute/v2.1/servers/2e3bce83-6dff-479d-a54c-8f660fbbcdc5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050264 Aug 04 05:33:54.982577 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 438/885] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Aug 4 05:33:54 2022] GET /compute/v2.1/servers/2e3bce83-6dff-479d-a54c-8f660fbbcdc5/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 05:33:55.021573 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-493e094e-ccd0-4d48-926e-cccfbc62fcd8 tempest-VolumesNegativeTest-91711685 tempest-VolumesNegativeTest-91711685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56d0ab5cf9d4c85841b57f4fe91107b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f6bda6801cf4d18abdeab209ec0037d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:33:55.030396 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-493e094e-ccd0-4d48-926e-cccfbc62fcd8 tempest-VolumesNegativeTest-91711685 tempest-VolumesNegativeTest-91711685-project] 10.222.0.46 "GET /compute/v2.1/servers/a010d7de-87af-4508-a13b-d307257e1e46" status: 200 len: 1315 microversion: 2.1 time: 0.163397 Aug 04 05:33:55.030973 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 448/886] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:33:54 2022] GET /compute/v2.1/servers/a010d7de-87af-4508-a13b-d307257e1e46 => generated 1315 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:33:55.993821 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-99194b04-f7e1-4177-94a9-d74383d14f47 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:33:55.995993 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-99194b04-f7e1-4177-94a9-d74383d14f47 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] [instance: 2e3bce83-6dff-479d-a54c-8f660fbbcdc5] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:33:56.003147 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-99194b04-f7e1-4177-94a9-d74383d14f47 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:33:56.005479 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-99194b04-f7e1-4177-94a9-d74383d14f47 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:33:56.005479 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-99194b04-f7e1-4177-94a9-d74383d14f47 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:33:56.005479 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-99194b04-f7e1-4177-94a9-d74383d14f47 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:33:56.036591 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-99194b04-f7e1-4177-94a9-d74383d14f47 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] 10.222.0.46 "GET /compute/v2.1/servers/2e3bce83-6dff-479d-a54c-8f660fbbcdc5/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.046731 Aug 04 05:33:56.037161 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 439/887] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Aug 4 05:33:55 2022] GET /compute/v2.1/servers/2e3bce83-6dff-479d-a54c-8f660fbbcdc5/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:33:56.051948 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-ea027254-d090-4344-aea2-a31258eebd4c tempest-VolumesNegativeTest-91711685 tempest-VolumesNegativeTest-91711685-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:33:56.053195 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-ea027254-d090-4344-aea2-a31258eebd4c tempest-VolumesNegativeTest-91711685 tempest-VolumesNegativeTest-91711685-project] [instance: a010d7de-87af-4508-a13b-d307257e1e46] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:33:56.059445 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-ea027254-d090-4344-aea2-a31258eebd4c tempest-VolumesNegativeTest-91711685 tempest-VolumesNegativeTest-91711685-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:33:56.062938 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-ea027254-d090-4344-aea2-a31258eebd4c tempest-VolumesNegativeTest-91711685 tempest-VolumesNegativeTest-91711685-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:33:56.062938 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-ea027254-d090-4344-aea2-a31258eebd4c tempest-VolumesNegativeTest-91711685 tempest-VolumesNegativeTest-91711685-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:33:56.062938 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-ea027254-d090-4344-aea2-a31258eebd4c tempest-VolumesNegativeTest-91711685 tempest-VolumesNegativeTest-91711685-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:33:56.102530 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-7a3e33ae-9bdd-49d5-921a-0a8a7d2c5347 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:33:56.103171 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-7a3e33ae-9bdd-49d5-921a-0a8a7d2c5347 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] [instance: 2e3bce83-6dff-479d-a54c-8f660fbbcdc5] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:33:56.109798 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-7a3e33ae-9bdd-49d5-921a-0a8a7d2c5347 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:33:56.110246 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-7a3e33ae-9bdd-49d5-921a-0a8a7d2c5347 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:33:56.111037 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-7a3e33ae-9bdd-49d5-921a-0a8a7d2c5347 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:33:56.111469 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-7a3e33ae-9bdd-49d5-921a-0a8a7d2c5347 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:33:56.136915 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-7a3e33ae-9bdd-49d5-921a-0a8a7d2c5347 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] [instance: 2e3bce83-6dff-479d-a54c-8f660fbbcdc5] Going to try to terminate instance {{(pid=118476) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 05:33:56.201022 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-ea027254-d090-4344-aea2-a31258eebd4c tempest-VolumesNegativeTest-91711685 tempest-VolumesNegativeTest-91711685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56d0ab5cf9d4c85841b57f4fe91107b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f6bda6801cf4d18abdeab209ec0037d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:33:56.208623 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-ea027254-d090-4344-aea2-a31258eebd4c tempest-VolumesNegativeTest-91711685 tempest-VolumesNegativeTest-91711685-project] 10.222.0.46 "GET /compute/v2.1/servers/a010d7de-87af-4508-a13b-d307257e1e46" status: 200 len: 1465 microversion: 2.1 time: 0.160878 Aug 04 05:33:56.209309 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 449/888] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:33:56 2022] GET /compute/v2.1/servers/a010d7de-87af-4508-a13b-d307257e1e46 => generated 1465 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:33:56.254286 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-62ed7976-00bf-404f-ab48-1ac996d34a2f tempest-VolumesNegativeTest-91711685 tempest-VolumesNegativeTest-91711685-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:33:56.254816 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-62ed7976-00bf-404f-ab48-1ac996d34a2f tempest-VolumesNegativeTest-91711685 tempest-VolumesNegativeTest-91711685-project] [instance: a010d7de-87af-4508-a13b-d307257e1e46] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:33:56.261036 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-62ed7976-00bf-404f-ab48-1ac996d34a2f tempest-VolumesNegativeTest-91711685 tempest-VolumesNegativeTest-91711685-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:33:56.261479 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-62ed7976-00bf-404f-ab48-1ac996d34a2f tempest-VolumesNegativeTest-91711685 tempest-VolumesNegativeTest-91711685-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:33:56.262255 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-62ed7976-00bf-404f-ab48-1ac996d34a2f tempest-VolumesNegativeTest-91711685 tempest-VolumesNegativeTest-91711685-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:33:56.262744 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-62ed7976-00bf-404f-ab48-1ac996d34a2f tempest-VolumesNegativeTest-91711685 tempest-VolumesNegativeTest-91711685-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:33:56.289929 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-62ed7976-00bf-404f-ab48-1ac996d34a2f tempest-VolumesNegativeTest-91711685 tempest-VolumesNegativeTest-91711685-project] [instance: a010d7de-87af-4508-a13b-d307257e1e46] Going to try to terminate instance {{(pid=118477) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 05:33:56.482300 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-7a3e33ae-9bdd-49d5-921a-0a8a7d2c5347 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] 10.222.0.46 "DELETE /compute/v2.1/servers/2e3bce83-6dff-479d-a54c-8f660fbbcdc5" status: 204 len: 0 microversion: 2.20 time: 0.383346 Aug 04 05:33:56.483395 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 440/889] 10.222.0.46 () {60 vars in 1280 bytes} [Thu Aug 4 05:33:56 2022] DELETE /compute/v2.1/servers/2e3bce83-6dff-479d-a54c-8f660fbbcdc5 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 04 05:33:56.491993 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-c97f49bc-202e-4098-98f8-a52c07a0fc41 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:33:56.492692 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-c97f49bc-202e-4098-98f8-a52c07a0fc41 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] [instance: 2e3bce83-6dff-479d-a54c-8f660fbbcdc5] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:33:56.498904 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-c97f49bc-202e-4098-98f8-a52c07a0fc41 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:33:56.499355 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-c97f49bc-202e-4098-98f8-a52c07a0fc41 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:33:56.500122 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-c97f49bc-202e-4098-98f8-a52c07a0fc41 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:33:56.500558 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-c97f49bc-202e-4098-98f8-a52c07a0fc41 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:33:56.613172 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-62ed7976-00bf-404f-ab48-1ac996d34a2f tempest-VolumesNegativeTest-91711685 tempest-VolumesNegativeTest-91711685-project] 10.222.0.46 "DELETE /compute/v2.1/servers/a010d7de-87af-4508-a13b-d307257e1e46" status: 204 len: 0 microversion: 2.1 time: 0.362349 Aug 04 05:33:56.613804 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 450/890] 10.222.0.46 () {58 vars in 1239 bytes} [Thu Aug 4 05:33:56 2022] DELETE /compute/v2.1/servers/a010d7de-87af-4508-a13b-d307257e1e46 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 04 05:33:56.623275 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-56335b2d-5d75-4e79-90f9-0c007335d4b4 tempest-VolumesNegativeTest-91711685 tempest-VolumesNegativeTest-91711685-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:33:56.623996 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-56335b2d-5d75-4e79-90f9-0c007335d4b4 tempest-VolumesNegativeTest-91711685 tempest-VolumesNegativeTest-91711685-project] [instance: a010d7de-87af-4508-a13b-d307257e1e46] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:33:56.631078 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-56335b2d-5d75-4e79-90f9-0c007335d4b4 tempest-VolumesNegativeTest-91711685 tempest-VolumesNegativeTest-91711685-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:33:56.631535 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-56335b2d-5d75-4e79-90f9-0c007335d4b4 tempest-VolumesNegativeTest-91711685 tempest-VolumesNegativeTest-91711685-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:33:56.632333 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-56335b2d-5d75-4e79-90f9-0c007335d4b4 tempest-VolumesNegativeTest-91711685 tempest-VolumesNegativeTest-91711685-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:33:56.632949 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-56335b2d-5d75-4e79-90f9-0c007335d4b4 tempest-VolumesNegativeTest-91711685 tempest-VolumesNegativeTest-91711685-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:33:56.647014 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-c97f49bc-202e-4098-98f8-a52c07a0fc41 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:33:56.657876 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-c97f49bc-202e-4098-98f8-a52c07a0fc41 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:33:56.659417 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-c97f49bc-202e-4098-98f8-a52c07a0fc41 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:33:56.660620 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-c97f49bc-202e-4098-98f8-a52c07a0fc41 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] 10.222.0.46 "GET /compute/v2.1/servers/2e3bce83-6dff-479d-a54c-8f660fbbcdc5" status: 200 len: 1724 microversion: 2.20 time: 0.172696 Aug 04 05:33:56.661424 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 441/891] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Aug 4 05:33:56 2022] GET /compute/v2.1/servers/2e3bce83-6dff-479d-a54c-8f660fbbcdc5 => generated 1724 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 05:33:56.779832 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-56335b2d-5d75-4e79-90f9-0c007335d4b4 tempest-VolumesNegativeTest-91711685 tempest-VolumesNegativeTest-91711685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56d0ab5cf9d4c85841b57f4fe91107b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f6bda6801cf4d18abdeab209ec0037d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:33:56.788022 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-56335b2d-5d75-4e79-90f9-0c007335d4b4 tempest-VolumesNegativeTest-91711685 tempest-VolumesNegativeTest-91711685-project] 10.222.0.46 "GET /compute/v2.1/servers/a010d7de-87af-4508-a13b-d307257e1e46" status: 200 len: 1471 microversion: 2.1 time: 0.169599 Aug 04 05:33:56.788922 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 451/892] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:33:56 2022] GET /compute/v2.1/servers/a010d7de-87af-4508-a13b-d307257e1e46 => generated 1471 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 05:33:57.683896 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-bd5a1121-9336-4c9c-9076-5c11f06e6a14 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:33:57.684498 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-bd5a1121-9336-4c9c-9076-5c11f06e6a14 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] [instance: 2e3bce83-6dff-479d-a54c-8f660fbbcdc5] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:33:57.691008 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-bd5a1121-9336-4c9c-9076-5c11f06e6a14 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:33:57.691450 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-bd5a1121-9336-4c9c-9076-5c11f06e6a14 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:33:57.692201 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-bd5a1121-9336-4c9c-9076-5c11f06e6a14 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:33:57.692628 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-bd5a1121-9336-4c9c-9076-5c11f06e6a14 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:33:57.711023 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG dbcounter [-] [118476] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:33:57.809042 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-3da270f8-4f5b-4ea7-9f34-a2d622447670 tempest-VolumesNegativeTest-91711685 tempest-VolumesNegativeTest-91711685-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:33:57.809672 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-3da270f8-4f5b-4ea7-9f34-a2d622447670 tempest-VolumesNegativeTest-91711685 tempest-VolumesNegativeTest-91711685-project] [instance: a010d7de-87af-4508-a13b-d307257e1e46] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:33:57.816407 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-3da270f8-4f5b-4ea7-9f34-a2d622447670 tempest-VolumesNegativeTest-91711685 tempest-VolumesNegativeTest-91711685-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:33:57.816849 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-3da270f8-4f5b-4ea7-9f34-a2d622447670 tempest-VolumesNegativeTest-91711685 tempest-VolumesNegativeTest-91711685-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:33:57.817604 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-3da270f8-4f5b-4ea7-9f34-a2d622447670 tempest-VolumesNegativeTest-91711685 tempest-VolumesNegativeTest-91711685-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:33:57.818032 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-3da270f8-4f5b-4ea7-9f34-a2d622447670 tempest-VolumesNegativeTest-91711685 tempest-VolumesNegativeTest-91711685-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:33:57.830814 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-bd5a1121-9336-4c9c-9076-5c11f06e6a14 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:33:57.835547 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-bd5a1121-9336-4c9c-9076-5c11f06e6a14 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:33:57.837156 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-bd5a1121-9336-4c9c-9076-5c11f06e6a14 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:33:57.838444 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-bd5a1121-9336-4c9c-9076-5c11f06e6a14 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] 10.222.0.46 "GET /compute/v2.1/servers/2e3bce83-6dff-479d-a54c-8f660fbbcdc5" status: 200 len: 1724 microversion: 2.20 time: 0.158404 Aug 04 05:33:57.839411 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 442/893] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Aug 4 05:33:57 2022] GET /compute/v2.1/servers/2e3bce83-6dff-479d-a54c-8f660fbbcdc5 => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 05:33:57.952756 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-3da270f8-4f5b-4ea7-9f34-a2d622447670 tempest-VolumesNegativeTest-91711685 tempest-VolumesNegativeTest-91711685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56d0ab5cf9d4c85841b57f4fe91107b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f6bda6801cf4d18abdeab209ec0037d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:33:57.960395 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-3da270f8-4f5b-4ea7-9f34-a2d622447670 tempest-VolumesNegativeTest-91711685 tempest-VolumesNegativeTest-91711685-project] 10.222.0.46 "GET /compute/v2.1/servers/a010d7de-87af-4508-a13b-d307257e1e46" status: 200 len: 1471 microversion: 2.1 time: 0.155244 Aug 04 05:33:57.960956 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 452/894] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:33:57 2022] GET /compute/v2.1/servers/a010d7de-87af-4508-a13b-d307257e1e46 => generated 1471 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 05:33:58.864326 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-a492f7f0-4fda-4a60-9e55-fabd4fe27e6e tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:33:58.864807 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-a492f7f0-4fda-4a60-9e55-fabd4fe27e6e tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] [instance: 2e3bce83-6dff-479d-a54c-8f660fbbcdc5] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:33:58.871835 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-a492f7f0-4fda-4a60-9e55-fabd4fe27e6e tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:33:58.872931 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-a492f7f0-4fda-4a60-9e55-fabd4fe27e6e tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:33:58.873725 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-a492f7f0-4fda-4a60-9e55-fabd4fe27e6e tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:33:58.874377 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-a492f7f0-4fda-4a60-9e55-fabd4fe27e6e tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:33:58.981496 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-d5e8d9e1-5678-4305-b987-3cdb7986be9e tempest-VolumesNegativeTest-91711685 tempest-VolumesNegativeTest-91711685-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:33:58.983375 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-d5e8d9e1-5678-4305-b987-3cdb7986be9e tempest-VolumesNegativeTest-91711685 tempest-VolumesNegativeTest-91711685-project] [instance: a010d7de-87af-4508-a13b-d307257e1e46] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:33:58.990759 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-d5e8d9e1-5678-4305-b987-3cdb7986be9e tempest-VolumesNegativeTest-91711685 tempest-VolumesNegativeTest-91711685-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:33:58.997236 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-d5e8d9e1-5678-4305-b987-3cdb7986be9e tempest-VolumesNegativeTest-91711685 tempest-VolumesNegativeTest-91711685-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:33:58.998252 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-d5e8d9e1-5678-4305-b987-3cdb7986be9e tempest-VolumesNegativeTest-91711685 tempest-VolumesNegativeTest-91711685-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:33:58.998712 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-d5e8d9e1-5678-4305-b987-3cdb7986be9e tempest-VolumesNegativeTest-91711685 tempest-VolumesNegativeTest-91711685-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:33:59.017914 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG dbcounter [-] [118477] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=118477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:33:59.060734 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-a492f7f0-4fda-4a60-9e55-fabd4fe27e6e tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:33:59.069006 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-a492f7f0-4fda-4a60-9e55-fabd4fe27e6e tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:33:59.070621 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-a492f7f0-4fda-4a60-9e55-fabd4fe27e6e tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:33:59.071855 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-a492f7f0-4fda-4a60-9e55-fabd4fe27e6e tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] 10.222.0.46 "GET /compute/v2.1/servers/2e3bce83-6dff-479d-a54c-8f660fbbcdc5" status: 200 len: 1724 microversion: 2.20 time: 0.212218 Aug 04 05:33:59.073253 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 443/895] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Aug 4 05:33:58 2022] GET /compute/v2.1/servers/2e3bce83-6dff-479d-a54c-8f660fbbcdc5 => generated 1724 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 05:33:59.158926 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-d5e8d9e1-5678-4305-b987-3cdb7986be9e tempest-VolumesNegativeTest-91711685 tempest-VolumesNegativeTest-91711685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56d0ab5cf9d4c85841b57f4fe91107b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f6bda6801cf4d18abdeab209ec0037d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:33:59.179876 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-d5e8d9e1-5678-4305-b987-3cdb7986be9e tempest-VolumesNegativeTest-91711685 tempest-VolumesNegativeTest-91711685-project] 10.222.0.46 "GET /compute/v2.1/servers/a010d7de-87af-4508-a13b-d307257e1e46" status: 200 len: 1471 microversion: 2.1 time: 0.199689 Aug 04 05:33:59.179876 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 453/896] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:33:58 2022] GET /compute/v2.1/servers/a010d7de-87af-4508-a13b-d307257e1e46 => generated 1471 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 05:34:00.097660 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-7ceed24a-d881-44e7-9455-bbacb2e726e2 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:34:00.099269 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-7ceed24a-d881-44e7-9455-bbacb2e726e2 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] [instance: 2e3bce83-6dff-479d-a54c-8f660fbbcdc5] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:34:00.106419 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-7ceed24a-d881-44e7-9455-bbacb2e726e2 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:34:00.108462 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-7ceed24a-d881-44e7-9455-bbacb2e726e2 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:34:00.109378 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-7ceed24a-d881-44e7-9455-bbacb2e726e2 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:34:00.109962 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-7ceed24a-d881-44e7-9455-bbacb2e726e2 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:34:00.200495 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-e723b8ba-15fc-4b4d-a512-a92822410b87 tempest-VolumesNegativeTest-91711685 tempest-VolumesNegativeTest-91711685-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:34:00.202340 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-e723b8ba-15fc-4b4d-a512-a92822410b87 tempest-VolumesNegativeTest-91711685 tempest-VolumesNegativeTest-91711685-project] [instance: a010d7de-87af-4508-a13b-d307257e1e46] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:34:00.209583 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-e723b8ba-15fc-4b4d-a512-a92822410b87 tempest-VolumesNegativeTest-91711685 tempest-VolumesNegativeTest-91711685-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:34:00.210104 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-e723b8ba-15fc-4b4d-a512-a92822410b87 tempest-VolumesNegativeTest-91711685 tempest-VolumesNegativeTest-91711685-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:34:00.210962 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-e723b8ba-15fc-4b4d-a512-a92822410b87 tempest-VolumesNegativeTest-91711685 tempest-VolumesNegativeTest-91711685-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:34:00.211774 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-e723b8ba-15fc-4b4d-a512-a92822410b87 tempest-VolumesNegativeTest-91711685 tempest-VolumesNegativeTest-91711685-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:34:00.486584 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-7ceed24a-d881-44e7-9455-bbacb2e726e2 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:34:00.495656 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-7ceed24a-d881-44e7-9455-bbacb2e726e2 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:34:00.497278 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-7ceed24a-d881-44e7-9455-bbacb2e726e2 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:34:00.498662 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-7ceed24a-d881-44e7-9455-bbacb2e726e2 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] 10.222.0.46 "GET /compute/v2.1/servers/2e3bce83-6dff-479d-a54c-8f660fbbcdc5" status: 200 len: 1724 microversion: 2.20 time: 0.407478 Aug 04 05:34:00.499277 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 444/897] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Aug 4 05:34:00 2022] GET /compute/v2.1/servers/2e3bce83-6dff-479d-a54c-8f660fbbcdc5 => generated 1724 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 05:34:00.535291 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-e723b8ba-15fc-4b4d-a512-a92822410b87 tempest-VolumesNegativeTest-91711685 tempest-VolumesNegativeTest-91711685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56d0ab5cf9d4c85841b57f4fe91107b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f6bda6801cf4d18abdeab209ec0037d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:34:00.543108 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-e723b8ba-15fc-4b4d-a512-a92822410b87 tempest-VolumesNegativeTest-91711685 tempest-VolumesNegativeTest-91711685-project] 10.222.0.46 "GET /compute/v2.1/servers/a010d7de-87af-4508-a13b-d307257e1e46" status: 200 len: 1471 microversion: 2.1 time: 0.347392 Aug 04 05:34:00.543719 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 454/898] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:34:00 2022] GET /compute/v2.1/servers/a010d7de-87af-4508-a13b-d307257e1e46 => generated 1471 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 05:34:00.687491 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [req-135a13df-b6dd-45bf-9dad-962e7f84146e req-3bb9fe1f-6125-4279-9a5f-77c73c73fe11 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a010d7de-87af-4508-a13b-d307257e1e46", "name": "network-vif-deleted", "tag": "0702b2d5-37dc-40b2-b1a3-437332ef2b1e"}]} {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:34:00.700061 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [req-135a13df-b6dd-45bf-9dad-962e7f84146e req-3bb9fe1f-6125-4279-9a5f-77c73c73fe11 service nova] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:34:00.700570 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [req-135a13df-b6dd-45bf-9dad-962e7f84146e req-3bb9fe1f-6125-4279-9a5f-77c73c73fe11 service nova] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:34:00.724653 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.compute.server_external_events [req-135a13df-b6dd-45bf-9dad-962e7f84146e req-3bb9fe1f-6125-4279-9a5f-77c73c73fe11 service nova] Creating event network-vif-deleted:0702b2d5-37dc-40b2-b1a3-437332ef2b1e for instance a010d7de-87af-4508-a13b-d307257e1e46 on hv-cinder-85207 Aug 04 05:34:00.726573 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [req-135a13df-b6dd-45bf-9dad-962e7f84146e req-3bb9fe1f-6125-4279-9a5f-77c73c73fe11 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044571 Aug 04 05:34:00.730917 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 445/899] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Aug 4 05:34:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:34:01.522079 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-28d781cb-434d-498d-8a56-448293b55089 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:34:01.522737 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-28d781cb-434d-498d-8a56-448293b55089 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] [instance: 2e3bce83-6dff-479d-a54c-8f660fbbcdc5] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:34:01.529686 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-28d781cb-434d-498d-8a56-448293b55089 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:34:01.530130 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-28d781cb-434d-498d-8a56-448293b55089 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:34:01.530934 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-28d781cb-434d-498d-8a56-448293b55089 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:34:01.531409 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-28d781cb-434d-498d-8a56-448293b55089 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:34:01.565588 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-28d781cb-434d-498d-8a56-448293b55089 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:34:01.566037 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-28d781cb-434d-498d-8a56-448293b55089 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:34:01.566526 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.objects.instance [None req-28d781cb-434d-498d-8a56-448293b55089 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lazy-loading 'fault' on Instance uuid 2e3bce83-6dff-479d-a54c-8f660fbbcdc5 {{(pid=118477) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 05:34:01.568004 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-74015025-9560-4abe-ae8c-e115eb033c21 tempest-VolumesNegativeTest-91711685 tempest-VolumesNegativeTest-91711685-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:34:01.569077 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-74015025-9560-4abe-ae8c-e115eb033c21 tempest-VolumesNegativeTest-91711685 tempest-VolumesNegativeTest-91711685-project] [instance: a010d7de-87af-4508-a13b-d307257e1e46] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:34:01.575771 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-74015025-9560-4abe-ae8c-e115eb033c21 tempest-VolumesNegativeTest-91711685 tempest-VolumesNegativeTest-91711685-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:34:01.577958 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-74015025-9560-4abe-ae8c-e115eb033c21 tempest-VolumesNegativeTest-91711685 tempest-VolumesNegativeTest-91711685-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:34:01.579060 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-74015025-9560-4abe-ae8c-e115eb033c21 tempest-VolumesNegativeTest-91711685 tempest-VolumesNegativeTest-91711685-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:34:01.579567 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-74015025-9560-4abe-ae8c-e115eb033c21 tempest-VolumesNegativeTest-91711685 tempest-VolumesNegativeTest-91711685-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:34:01.608609 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-28d781cb-434d-498d-8a56-448293b55089 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:34:01.616586 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-28d781cb-434d-498d-8a56-448293b55089 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:34:01.618176 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-28d781cb-434d-498d-8a56-448293b55089 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:34:01.619429 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-28d781cb-434d-498d-8a56-448293b55089 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] 10.222.0.46 "GET /compute/v2.1/servers/2e3bce83-6dff-479d-a54c-8f660fbbcdc5" status: 200 len: 1371 microversion: 2.20 time: 0.101269 Aug 04 05:34:01.620330 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 455/900] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Aug 4 05:34:01 2022] GET /compute/v2.1/servers/2e3bce83-6dff-479d-a54c-8f660fbbcdc5 => generated 1371 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 05:34:01.624631 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-74015025-9560-4abe-ae8c-e115eb033c21 tempest-VolumesNegativeTest-91711685 tempest-VolumesNegativeTest-91711685-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:34:01.625075 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-74015025-9560-4abe-ae8c-e115eb033c21 tempest-VolumesNegativeTest-91711685 tempest-VolumesNegativeTest-91711685-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:34:01.625552 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.objects.instance [None req-74015025-9560-4abe-ae8c-e115eb033c21 tempest-VolumesNegativeTest-91711685 tempest-VolumesNegativeTest-91711685-project] Lazy-loading 'fault' on Instance uuid a010d7de-87af-4508-a13b-d307257e1e46 {{(pid=118476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 05:34:01.674511 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-74015025-9560-4abe-ae8c-e115eb033c21 tempest-VolumesNegativeTest-91711685 tempest-VolumesNegativeTest-91711685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56d0ab5cf9d4c85841b57f4fe91107b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f6bda6801cf4d18abdeab209ec0037d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:34:01.682124 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-74015025-9560-4abe-ae8c-e115eb033c21 tempest-VolumesNegativeTest-91711685 tempest-VolumesNegativeTest-91711685-project] 10.222.0.46 "GET /compute/v2.1/servers/a010d7de-87af-4508-a13b-d307257e1e46" status: 200 len: 1305 microversion: 2.1 time: 0.119412 Aug 04 05:34:01.682875 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 446/901] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:34:01 2022] GET /compute/v2.1/servers/a010d7de-87af-4508-a13b-d307257e1e46 => generated 1305 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 05:34:02.643036 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-dfdc85ab-395a-46e3-b96f-8f99c90c1478 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:34:02.643647 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-dfdc85ab-395a-46e3-b96f-8f99c90c1478 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] [instance: 2e3bce83-6dff-479d-a54c-8f660fbbcdc5] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:34:02.650156 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-dfdc85ab-395a-46e3-b96f-8f99c90c1478 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:34:02.650630 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-dfdc85ab-395a-46e3-b96f-8f99c90c1478 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:34:02.651390 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-dfdc85ab-395a-46e3-b96f-8f99c90c1478 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:34:02.651826 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-dfdc85ab-395a-46e3-b96f-8f99c90c1478 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:34:02.665524 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.wsgi [None req-dfdc85ab-395a-46e3-b96f-8f99c90c1478 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] HTTP exception thrown: Instance 2e3bce83-6dff-479d-a54c-8f660fbbcdc5 could not be found. Aug 04 05:34:02.667198 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-dfdc85ab-395a-46e3-b96f-8f99c90c1478 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Request method failure captured: Aug 04 05:34:02.667198 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: request: GET /compute/v2.1/servers/2e3bce83-6dff-479d-a54c-8f660fbbcdc5 HTTP/1.1 Aug 04 05:34:02.667198 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: Accept: application/json Aug 04 05:34:02.667198 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: Accept-Encoding: identity Aug 04 05:34:02.667198 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: Connection: close Aug 04 05:34:02.667198 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: Content-Length: 0 Aug 04 05:34:02.667198 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: Content-Type: application/json Aug 04 05:34:02.667198 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: Host: 10.222.0.46 Aug 04 05:34:02.667198 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: Openstack-System-Scope: None Aug 04 05:34:02.667198 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: User-Agent: python-urllib3/1.26.11 Aug 04 05:34:02.667198 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Auth-Token: gAAAAABi61mTHXwa9t7PYnVh0SPDIlBJIwH6LJUi-4pbY05vY4D2vuiCk0K_0F9Ze5K3uUqFaa6qtBDZH936B4jmOWpxOLx0Bgos7-B8IgRAneYH0qpvjY1JAMAclXqNfVN0dl8X_WsdkL_aE3tD6DYHka6udZU76mlMPKDTUJQRW8RF5JdDLEY Aug 04 05:34:02.667198 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Domain-Id: None Aug 04 05:34:02.667198 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Domain-Name: None Aug 04 05:34:02.667198 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Identity-Status: Confirmed Aug 04 05:34:02.667198 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Is-Admin-Project: True Aug 04 05:34:02.667198 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Openstack-Nova-Api-Version: 2.20 Aug 04 05:34:02.667198 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Project-Domain-Id: default Aug 04 05:34:02.667198 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Project-Domain-Name: Default Aug 04 05:34:02.667198 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Project-Id: 290c5e886bf64e989f2be4b94a570e3f Aug 04 05:34:02.667198 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1441164991 Aug 04 05:34:02.667198 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Role: member,reader Aug 04 05:34:02.667198 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Roles: member,reader Aug 04 05:34:02.669003 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/290c5e886bf64e989f2be4b94a570e3f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/290c5e886bf64e989f2be4b94a570e3f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_290c5e886bf64e989f2be4b94a570e3f", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/290c5e886bf64e989f2be4b94a570e3f"}]}] Aug 04 05:34:02.669003 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1441164991 Aug 04 05:34:02.669003 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Tenant-Id: 290c5e886bf64e989f2be4b94a570e3f Aug 04 05:34:02.669003 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1441164991 Aug 04 05:34:02.669003 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-User: tempest-AttachVolumeShelveTestJSON-1441164991-project Aug 04 05:34:02.669003 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-User-Domain-Id: default Aug 04 05:34:02.669003 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-User-Domain-Name: Default Aug 04 05:34:02.669003 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-User-Id: fd2797b8820c41a2ae939fd7c473a549 Aug 04 05:34:02.669003 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1441164991-project Aug 04 05:34:02.669003 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: method: > Aug 04 05:34:02.669003 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: exception: Instance 2e3bce83-6dff-479d-a54c-8f660fbbcdc5 could not be found. Aug 04 05:34:02.669003 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: action_args: {'id': '2e3bce83-6dff-479d-a54c-8f660fbbcdc5'} Aug 04 05:34:02.670340 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 05:34:02.670340 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:34:02.670340 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 05:34:02.670340 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 05:34:02.670340 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 05:34:02.670340 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 05:34:02.670340 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 05:34:02.670340 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 05:34:02.670340 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 05:34:02.670340 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 05:34:02.670340 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2e3bce83-6dff-479d-a54c-8f660fbbcdc5 could not be found. Aug 04 05:34:02.670340 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Aug 04 05:34:02.670340 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:34:02.670340 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Aug 04 05:34:02.670340 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:34:02.670340 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:34:02.670340 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:34:02.670340 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 05:34:02.670340 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 05:34:02.670340 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 05:34:02.671859 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 05:34:02.671859 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 05:34:02.671859 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 05:34:02.671859 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 05:34:02.671859 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 05:34:02.671859 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 05:34:02.671859 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 05:34:02.671859 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2e3bce83-6dff-479d-a54c-8f660fbbcdc5 could not be found. Aug 04 05:34:02.671859 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Aug 04 05:34:02.671859 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:34:02.671859 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Aug 04 05:34:02.671859 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:34:02.671859 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:34:02.671859 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:34:02.671859 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 05:34:02.671859 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 05:34:02.671859 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2e3bce83-6dff-479d-a54c-8f660fbbcdc5 could not be found. Aug 04 05:34:02.671859 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Aug 04 05:34:02.673330 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-dfdc85ab-395a-46e3-b96f-8f99c90c1478 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Returning 404 to user: Instance 2e3bce83-6dff-479d-a54c-8f660fbbcdc5 could not be found. {{(pid=118477) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 05:34:02.673330 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-dfdc85ab-395a-46e3-b96f-8f99c90c1478 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] 10.222.0.46 "GET /compute/v2.1/servers/2e3bce83-6dff-479d-a54c-8f660fbbcdc5" status: 404 len: 111 microversion: 2.20 time: 0.029442 Aug 04 05:34:02.673330 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 456/902] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Aug 4 05:34:02 2022] GET /compute/v2.1/servers/2e3bce83-6dff-479d-a54c-8f660fbbcdc5 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 04 05:34:02.677988 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-2794b966-93a5-49a4-8054-2e3e44f8262f tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Calling method '.version_select at 0x7f14755b7790>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:34:02.705163 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-9e6beb0e-51a5-4415-b211-065e887257bc tempest-VolumesNegativeTest-91711685 tempest-VolumesNegativeTest-91711685-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:34:02.705813 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-9e6beb0e-51a5-4415-b211-065e887257bc tempest-VolumesNegativeTest-91711685 tempest-VolumesNegativeTest-91711685-project] [instance: a010d7de-87af-4508-a13b-d307257e1e46] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:34:02.711938 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-9e6beb0e-51a5-4415-b211-065e887257bc tempest-VolumesNegativeTest-91711685 tempest-VolumesNegativeTest-91711685-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:34:02.712386 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-9e6beb0e-51a5-4415-b211-065e887257bc tempest-VolumesNegativeTest-91711685 tempest-VolumesNegativeTest-91711685-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:34:02.713159 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-9e6beb0e-51a5-4415-b211-065e887257bc tempest-VolumesNegativeTest-91711685 tempest-VolumesNegativeTest-91711685-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:34:02.713578 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-9e6beb0e-51a5-4415-b211-065e887257bc tempest-VolumesNegativeTest-91711685 tempest-VolumesNegativeTest-91711685-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:34:02.727909 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.wsgi [None req-9e6beb0e-51a5-4415-b211-065e887257bc tempest-VolumesNegativeTest-91711685 tempest-VolumesNegativeTest-91711685-project] HTTP exception thrown: Instance a010d7de-87af-4508-a13b-d307257e1e46 could not be found. Aug 04 05:34:02.729562 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-9e6beb0e-51a5-4415-b211-065e887257bc tempest-VolumesNegativeTest-91711685 tempest-VolumesNegativeTest-91711685-project] Request method failure captured: Aug 04 05:34:02.729562 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: request: GET /compute/v2.1/servers/a010d7de-87af-4508-a13b-d307257e1e46 HTTP/1.1 Aug 04 05:34:02.729562 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: Accept: application/json Aug 04 05:34:02.729562 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: Accept-Encoding: identity Aug 04 05:34:02.729562 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: Connection: close Aug 04 05:34:02.729562 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: Content-Length: 0 Aug 04 05:34:02.729562 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: Content-Type: application/json Aug 04 05:34:02.729562 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: Host: 10.222.0.46 Aug 04 05:34:02.729562 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: Openstack-System-Scope: None Aug 04 05:34:02.729562 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: User-Agent: python-urllib3/1.26.11 Aug 04 05:34:02.729562 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Auth-Token: gAAAAABi61oqVhdWALKJ1YCVzN-M3nsIl2d6Bk8Xv05wp-rNt7o7ieGt8n_X0jLGC2r_gTjz5ETavBXRmYT70OIrKtVC8dbM8ZT7mjGTGuzGVuHkg8vzSfTi4U9x2o7IAqOHgikmcwDzdGR125F8dd9t2jBVwZhnDe3OYLcgOSW6dFoxIqXVPpw Aug 04 05:34:02.729562 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Domain-Id: None Aug 04 05:34:02.729562 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Domain-Name: None Aug 04 05:34:02.729562 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Identity-Status: Confirmed Aug 04 05:34:02.729562 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Is-Admin-Project: True Aug 04 05:34:02.729562 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Project-Domain-Id: default Aug 04 05:34:02.729562 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Project-Domain-Name: Default Aug 04 05:34:02.729562 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Project-Id: 2f6bda6801cf4d18abdeab209ec0037d Aug 04 05:34:02.729562 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Project-Name: tempest-VolumesNegativeTest-91711685 Aug 04 05:34:02.729562 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Role: member,reader Aug 04 05:34:02.729562 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Roles: member,reader Aug 04 05:34:02.731251 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/2f6bda6801cf4d18abdeab209ec0037d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/2f6bda6801cf4d18abdeab209ec0037d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_2f6bda6801cf4d18abdeab209ec0037d", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/2f6bda6801cf4d18abdeab209ec0037d"}]}] Aug 04 05:34:02.731251 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Tenant: tempest-VolumesNegativeTest-91711685 Aug 04 05:34:02.731251 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Tenant-Id: 2f6bda6801cf4d18abdeab209ec0037d Aug 04 05:34:02.731251 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Tenant-Name: tempest-VolumesNegativeTest-91711685 Aug 04 05:34:02.731251 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-User: tempest-VolumesNegativeTest-91711685-project Aug 04 05:34:02.731251 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-User-Domain-Id: default Aug 04 05:34:02.731251 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-User-Domain-Name: Default Aug 04 05:34:02.731251 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-User-Id: f56d0ab5cf9d4c85841b57f4fe91107b Aug 04 05:34:02.731251 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-User-Name: tempest-VolumesNegativeTest-91711685-project Aug 04 05:34:02.731251 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: method: > Aug 04 05:34:02.731251 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: exception: Instance a010d7de-87af-4508-a13b-d307257e1e46 could not be found. Aug 04 05:34:02.731251 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: action_args: {'id': 'a010d7de-87af-4508-a13b-d307257e1e46'} Aug 04 05:34:02.732283 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 05:34:02.732283 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:34:02.732283 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 05:34:02.732283 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 05:34:02.732283 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 05:34:02.732283 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 05:34:02.732283 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 05:34:02.732283 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 05:34:02.732283 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 05:34:02.732283 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 05:34:02.732283 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a010d7de-87af-4508-a13b-d307257e1e46 could not be found. Aug 04 05:34:02.732283 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Aug 04 05:34:02.732283 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:34:02.732283 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Aug 04 05:34:02.732283 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:34:02.732283 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:34:02.732283 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:34:02.732283 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 05:34:02.732283 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 05:34:02.732283 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 05:34:02.733718 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 05:34:02.733718 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 05:34:02.733718 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 05:34:02.733718 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 05:34:02.733718 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 05:34:02.733718 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 05:34:02.733718 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 05:34:02.733718 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a010d7de-87af-4508-a13b-d307257e1e46 could not be found. Aug 04 05:34:02.733718 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Aug 04 05:34:02.733718 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:34:02.733718 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Aug 04 05:34:02.733718 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:34:02.733718 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:34:02.733718 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:34:02.733718 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 05:34:02.733718 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 05:34:02.733718 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a010d7de-87af-4508-a13b-d307257e1e46 could not be found. Aug 04 05:34:02.733718 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Aug 04 05:34:02.740713 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-9e6beb0e-51a5-4415-b211-065e887257bc tempest-VolumesNegativeTest-91711685 tempest-VolumesNegativeTest-91711685-project] Returning 404 to user: Instance a010d7de-87af-4508-a13b-d307257e1e46 could not be found. {{(pid=118477) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 05:34:02.740713 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-9e6beb0e-51a5-4415-b211-065e887257bc tempest-VolumesNegativeTest-91711685 tempest-VolumesNegativeTest-91711685-project] 10.222.0.46 "GET /compute/v2.1/servers/a010d7de-87af-4508-a13b-d307257e1e46" status: 404 len: 111 microversion: 2.1 time: 0.030314 Aug 04 05:34:02.740713 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 457/903] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:34:02 2022] GET /compute/v2.1/servers/a010d7de-87af-4508-a13b-d307257e1e46 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 04 05:34:02.786197 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [req-f37efa72-aff3-4b9a-a91e-cfbb0ca2dc51 req-6ec5c2e7-cb52-450e-8d32-1eaf3a209c03 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e3bce83-6dff-479d-a54c-8f660fbbcdc5", "name": "network-vif-deleted", "tag": "ddeaefd6-9468-4764-8ef0-df45fd5ea8db"}]} {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:34:02.796696 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [req-f37efa72-aff3-4b9a-a91e-cfbb0ca2dc51 req-6ec5c2e7-cb52-450e-8d32-1eaf3a209c03 service nova] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:34:02.797195 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [req-f37efa72-aff3-4b9a-a91e-cfbb0ca2dc51 req-6ec5c2e7-cb52-450e-8d32-1eaf3a209c03 service nova] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:34:02.808287 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.compute.server_external_events [req-f37efa72-aff3-4b9a-a91e-cfbb0ca2dc51 req-6ec5c2e7-cb52-450e-8d32-1eaf3a209c03 service nova] Creating event network-vif-deleted:ddeaefd6-9468-4764-8ef0-df45fd5ea8db for instance 2e3bce83-6dff-479d-a54c-8f660fbbcdc5 on hv-cinder-85207 Aug 04 05:34:02.813846 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [req-f37efa72-aff3-4b9a-a91e-cfbb0ca2dc51 req-6ec5c2e7-cb52-450e-8d32-1eaf3a209c03 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031254 Aug 04 05:34:02.814655 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 458/904] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Aug 4 05:34:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 05:34:02.831364 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-2794b966-93a5-49a4-8054-2e3e44f8262f tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-805187364" status: 204 len: 0 microversion: 2.20 time: 0.157259 Aug 04 05:34:02.831956 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 447/905] 10.222.0.46 () {60 vars in 1259 bytes} [Thu Aug 4 05:34:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-805187364 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 04 05:34:03.674856 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-78f1fdc2-9444-40b3-abb8-9e2d40c62371 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Action: 'create', calling method: .version_select at 0x7f14754a3e50>, body: {"keypair": {"name": "tempest-keypair-1770183330", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF4GiCDHBDSH4fmcZ7UJin0mm4UmA4l2zG9xIxpWpIFMVELxLY3/EwA08vo/iBzVFgFMTudBf9bU/gYE66R+G8Nd0CypZJixSSoXZa+vxmpSmB2ESm+QsuGCc0JeG6Md8g=="}} {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:34:03.680452 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG dbcounter [-] [118477] Writing DB stats nova_api:SELECT=58,nova_api:UPDATE=1 {{(pid=118477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:34:03.691570 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.quota [None req-78f1fdc2-9444-40b3-abb8-9e2d40c62371 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Getting quotas for project 290c5e886bf64e989f2be4b94a570e3f. Resources: {'key_pairs'} {{(pid=118477) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 05:34:03.695403 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.quota [None req-78f1fdc2-9444-40b3-abb8-9e2d40c62371 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Getting quotas for user fd2797b8820c41a2ae939fd7c473a549 and project 290c5e886bf64e989f2be4b94a570e3f. Resources: {'key_pairs'} {{(pid=118477) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 05:34:03.791191 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-78f1fdc2-9444-40b3-abb8-9e2d40c62371 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.122519 Aug 04 05:34:03.791819 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 459/906] 10.222.0.46 () {62 vars in 1200 bytes} [Thu Aug 4 05:34:03 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 124 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 04 05:34:06.369696 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-035750bc-b83b-438d-baf4-884fc7aa6578 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-433147041", "imageRef": "4613f7d0-37ca-46ad-bb26-dc4990dd7d6f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e4a59e7d-a01a-4b8d-82ee-61f087655ac3"}], "security_groups": [{"name": "tempest-securitygroup--1693944901"}], "key_name": "tempest-keypair-1770183330", "user_data": "}} {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:34:06.380637 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG dbcounter [-] [118476] Writing DB stats nova_api:SELECT=70,nova_api:INSERT=3,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=118476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:34:06.476275 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.network.neutron [None req-035750bc-b83b-438d-baf4-884fc7aa6578 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] validate_networks() for [('e4a59e7d-a01a-4b8d-82ee-61f087655ac3', None, None, None, None, None)] {{(pid=118476) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 05:34:06.875052 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.virt.hardware [None req-035750bc-b83b-438d-baf4-884fc7aa6578 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Flavor limits 0:0:0 {{(pid=118476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 05:34:06.875777 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.virt.hardware [None req-035750bc-b83b-438d-baf4-884fc7aa6578 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Image limits 0:0:0 {{(pid=118476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 05:34:06.876323 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.virt.hardware [None req-035750bc-b83b-438d-baf4-884fc7aa6578 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Flavor pref 0:0:0 {{(pid=118476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 05:34:06.876978 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.virt.hardware [None req-035750bc-b83b-438d-baf4-884fc7aa6578 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Image pref 0:0:0 {{(pid=118476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 05:34:06.877693 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.virt.hardware [None req-035750bc-b83b-438d-baf4-884fc7aa6578 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 05:34:06.886856 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-035750bc-b83b-438d-baf4-884fc7aa6578 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:34:06.889175 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-035750bc-b83b-438d-baf4-884fc7aa6578 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:34:06.889175 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-035750bc-b83b-438d-baf4-884fc7aa6578 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:34:06.889175 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-035750bc-b83b-438d-baf4-884fc7aa6578 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:34:06.907820 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.quota [None req-035750bc-b83b-438d-baf4-884fc7aa6578 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Getting quotas for project 290c5e886bf64e989f2be4b94a570e3f. Resources: {'instances', 'cores', 'ram'} {{(pid=118476) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 05:34:06.912961 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.quota [None req-035750bc-b83b-438d-baf4-884fc7aa6578 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Getting quotas for user fd2797b8820c41a2ae939fd7c473a549 and project 290c5e886bf64e989f2be4b94a570e3f. Resources: {'instances', 'cores', 'ram'} {{(pid=118476) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 05:34:06.926397 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-035750bc-b83b-438d-baf4-884fc7aa6578 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Going to run 1 instances... {{(pid=118476) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 05:34:06.928660 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-035750bc-b83b-438d-baf4-884fc7aa6578 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] [instance: e69d4892-0a83-4d51-8ffd-904f1050907d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4613f7d0-37ca-46ad-bb26-dc4990dd7d6f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118476) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 05:34:07.044598 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-035750bc-b83b-438d-baf4-884fc7aa6578 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.679760 Aug 04 05:34:07.045577 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 448/907] 10.222.0.46 () {62 vars in 1188 bytes} [Thu Aug 4 05:34:06 2022] POST /compute/v2.1/servers => generated 402 bytes in 682 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 04 05:34:07.056208 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-ab87a868-e2a9-47dc-8315-136df0db65b1 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:34:07.056941 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-ab87a868-e2a9-47dc-8315-136df0db65b1 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] [instance: e69d4892-0a83-4d51-8ffd-904f1050907d] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:34:07.129377 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-ab87a868-e2a9-47dc-8315-136df0db65b1 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:34:07.149358 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-ab87a868-e2a9-47dc-8315-136df0db65b1 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:34:07.149358 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-ab87a868-e2a9-47dc-8315-136df0db65b1 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:34:07.149358 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-ab87a868-e2a9-47dc-8315-136df0db65b1 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] 10.222.0.46 "GET /compute/v2.1/servers/e69d4892-0a83-4d51-8ffd-904f1050907d" status: 200 len: 1281 microversion: 2.20 time: 0.093177 Aug 04 05:34:07.149833 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 460/908] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Aug 4 05:34:07 2022] GET /compute/v2.1/servers/e69d4892-0a83-4d51-8ffd-904f1050907d => generated 1281 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 05:34:08.170932 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-7504523d-7c3c-45d5-b153-baae537388a6 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:34:08.171611 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-7504523d-7c3c-45d5-b153-baae537388a6 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] [instance: e69d4892-0a83-4d51-8ffd-904f1050907d] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:34:08.179452 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-7504523d-7c3c-45d5-b153-baae537388a6 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:34:08.179948 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-7504523d-7c3c-45d5-b153-baae537388a6 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:34:08.180716 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-7504523d-7c3c-45d5-b153-baae537388a6 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:34:08.181216 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-7504523d-7c3c-45d5-b153-baae537388a6 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:34:08.245231 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-7504523d-7c3c-45d5-b153-baae537388a6 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:34:08.253793 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-7504523d-7c3c-45d5-b153-baae537388a6 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:34:08.255335 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-7504523d-7c3c-45d5-b153-baae537388a6 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:34:08.256561 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-7504523d-7c3c-45d5-b153-baae537388a6 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] 10.222.0.46 "GET /compute/v2.1/servers/e69d4892-0a83-4d51-8ffd-904f1050907d" status: 200 len: 1285 microversion: 2.20 time: 0.091320 Aug 04 05:34:08.257123 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 449/909] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Aug 4 05:34:08 2022] GET /compute/v2.1/servers/e69d4892-0a83-4d51-8ffd-904f1050907d => generated 1285 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 05:34:09.280747 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-db6b1504-1707-446c-acb9-6ec01c53b54b tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:34:09.282465 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-db6b1504-1707-446c-acb9-6ec01c53b54b tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] [instance: e69d4892-0a83-4d51-8ffd-904f1050907d] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:34:09.289157 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-db6b1504-1707-446c-acb9-6ec01c53b54b tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:34:09.289601 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-db6b1504-1707-446c-acb9-6ec01c53b54b tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:34:09.290634 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-db6b1504-1707-446c-acb9-6ec01c53b54b tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:34:09.291060 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-db6b1504-1707-446c-acb9-6ec01c53b54b tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:34:09.369152 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-db6b1504-1707-446c-acb9-6ec01c53b54b tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:34:09.381955 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-db6b1504-1707-446c-acb9-6ec01c53b54b tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:34:09.385277 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-db6b1504-1707-446c-acb9-6ec01c53b54b tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:34:09.390260 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-db6b1504-1707-446c-acb9-6ec01c53b54b tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] 10.222.0.46 "GET /compute/v2.1/servers/e69d4892-0a83-4d51-8ffd-904f1050907d" status: 200 len: 1341 microversion: 2.20 time: 0.110640 Aug 04 05:34:09.390260 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 461/910] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Aug 4 05:34:09 2022] GET /compute/v2.1/servers/e69d4892-0a83-4d51-8ffd-904f1050907d => generated 1341 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 05:34:10.419879 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-40d6f241-b944-484d-9fb7-1fef77e2e5aa tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:34:10.419879 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-40d6f241-b944-484d-9fb7-1fef77e2e5aa tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] [instance: e69d4892-0a83-4d51-8ffd-904f1050907d] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:34:10.424826 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-40d6f241-b944-484d-9fb7-1fef77e2e5aa tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:34:10.427503 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-40d6f241-b944-484d-9fb7-1fef77e2e5aa tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:34:10.431125 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-40d6f241-b944-484d-9fb7-1fef77e2e5aa tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:34:10.431814 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-40d6f241-b944-484d-9fb7-1fef77e2e5aa tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:34:10.706256 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-40d6f241-b944-484d-9fb7-1fef77e2e5aa tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:34:10.714496 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-40d6f241-b944-484d-9fb7-1fef77e2e5aa tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:34:10.716162 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-40d6f241-b944-484d-9fb7-1fef77e2e5aa tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:34:10.717379 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-40d6f241-b944-484d-9fb7-1fef77e2e5aa tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] 10.222.0.46 "GET /compute/v2.1/servers/e69d4892-0a83-4d51-8ffd-904f1050907d" status: 200 len: 1407 microversion: 2.20 time: 0.309647 Aug 04 05:34:10.718325 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 450/911] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Aug 4 05:34:10 2022] GET /compute/v2.1/servers/e69d4892-0a83-4d51-8ffd-904f1050907d => generated 1407 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 05:34:11.144474 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [req-9095c406-cb25-47f0-b77e-4f61ef559957 req-0f8913bc-1ddf-48d3-bda8-fc13035d9883 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e69d4892-0a83-4d51-8ffd-904f1050907d", "tag": "846d125f-c82c-42db-8ed7-fe055882b03c"}]} {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:34:11.158126 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [req-9095c406-cb25-47f0-b77e-4f61ef559957 req-0f8913bc-1ddf-48d3-bda8-fc13035d9883 service nova] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:34:11.158908 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [req-9095c406-cb25-47f0-b77e-4f61ef559957 req-0f8913bc-1ddf-48d3-bda8-fc13035d9883 service nova] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:34:11.171701 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.compute.server_external_events [req-9095c406-cb25-47f0-b77e-4f61ef559957 req-0f8913bc-1ddf-48d3-bda8-fc13035d9883 service nova] Creating event network-changed:846d125f-c82c-42db-8ed7-fe055882b03c for instance e69d4892-0a83-4d51-8ffd-904f1050907d on hv-cinder-85207 Aug 04 05:34:11.177561 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [req-9095c406-cb25-47f0-b77e-4f61ef559957 req-0f8913bc-1ddf-48d3-bda8-fc13035d9883 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037429 Aug 04 05:34:11.178496 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 462/912] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Aug 4 05:34:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 05:34:11.742764 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-8e95b618-c35a-4129-ba24-f19c26af6ef4 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:34:11.743497 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-8e95b618-c35a-4129-ba24-f19c26af6ef4 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] [instance: e69d4892-0a83-4d51-8ffd-904f1050907d] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:34:11.750385 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-8e95b618-c35a-4129-ba24-f19c26af6ef4 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:34:11.757071 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-8e95b618-c35a-4129-ba24-f19c26af6ef4 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:34:11.757071 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-8e95b618-c35a-4129-ba24-f19c26af6ef4 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:34:11.757071 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-8e95b618-c35a-4129-ba24-f19c26af6ef4 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:34:12.303118 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-8e95b618-c35a-4129-ba24-f19c26af6ef4 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:34:12.313308 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-8e95b618-c35a-4129-ba24-f19c26af6ef4 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:34:12.314767 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-8e95b618-c35a-4129-ba24-f19c26af6ef4 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:34:12.315903 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-8e95b618-c35a-4129-ba24-f19c26af6ef4 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] 10.222.0.46 "GET /compute/v2.1/servers/e69d4892-0a83-4d51-8ffd-904f1050907d" status: 200 len: 1407 microversion: 2.20 time: 0.577252 Aug 04 05:34:12.316467 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 451/913] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Aug 4 05:34:11 2022] GET /compute/v2.1/servers/e69d4892-0a83-4d51-8ffd-904f1050907d => generated 1407 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 05:34:13.340976 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-e6a77443-1741-460f-89da-723f1815cba0 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:34:13.341686 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-e6a77443-1741-460f-89da-723f1815cba0 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] [instance: e69d4892-0a83-4d51-8ffd-904f1050907d] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:34:13.348267 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-e6a77443-1741-460f-89da-723f1815cba0 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:34:13.348714 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-e6a77443-1741-460f-89da-723f1815cba0 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:34:13.349486 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-e6a77443-1741-460f-89da-723f1815cba0 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:34:13.349924 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-e6a77443-1741-460f-89da-723f1815cba0 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:34:13.495702 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-e6a77443-1741-460f-89da-723f1815cba0 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:34:13.511588 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-e6a77443-1741-460f-89da-723f1815cba0 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:34:13.511588 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-e6a77443-1741-460f-89da-723f1815cba0 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:34:13.511588 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-e6a77443-1741-460f-89da-723f1815cba0 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] 10.222.0.46 "GET /compute/v2.1/servers/e69d4892-0a83-4d51-8ffd-904f1050907d" status: 200 len: 1407 microversion: 2.20 time: 0.174934 Aug 04 05:34:13.516121 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 463/914] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Aug 4 05:34:13 2022] GET /compute/v2.1/servers/e69d4892-0a83-4d51-8ffd-904f1050907d => generated 1407 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 05:34:14.535499 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-3d902197-10af-458a-91c5-c0b5caf65613 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:34:14.536305 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-3d902197-10af-458a-91c5-c0b5caf65613 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] [instance: e69d4892-0a83-4d51-8ffd-904f1050907d] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:34:14.543383 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-3d902197-10af-458a-91c5-c0b5caf65613 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:34:14.543830 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-3d902197-10af-458a-91c5-c0b5caf65613 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:34:14.545175 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-3d902197-10af-458a-91c5-c0b5caf65613 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:34:14.546232 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-3d902197-10af-458a-91c5-c0b5caf65613 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:34:14.691170 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-3d902197-10af-458a-91c5-c0b5caf65613 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:34:14.702083 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-3d902197-10af-458a-91c5-c0b5caf65613 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:34:14.703887 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-3d902197-10af-458a-91c5-c0b5caf65613 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:34:14.705247 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-3d902197-10af-458a-91c5-c0b5caf65613 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] 10.222.0.46 "GET /compute/v2.1/servers/e69d4892-0a83-4d51-8ffd-904f1050907d" status: 200 len: 1407 microversion: 2.20 time: 0.173808 Aug 04 05:34:14.705811 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 452/915] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Aug 4 05:34:14 2022] GET /compute/v2.1/servers/e69d4892-0a83-4d51-8ffd-904f1050907d => generated 1407 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 05:34:15.728796 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-bb2bf391-6a47-4e64-9a09-b94cf02e5720 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:34:15.735105 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-bb2bf391-6a47-4e64-9a09-b94cf02e5720 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] [instance: e69d4892-0a83-4d51-8ffd-904f1050907d] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:34:15.736139 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-bb2bf391-6a47-4e64-9a09-b94cf02e5720 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:34:15.736641 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-bb2bf391-6a47-4e64-9a09-b94cf02e5720 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:34:15.737357 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-bb2bf391-6a47-4e64-9a09-b94cf02e5720 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:34:15.737788 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-bb2bf391-6a47-4e64-9a09-b94cf02e5720 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:34:15.966250 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-bb2bf391-6a47-4e64-9a09-b94cf02e5720 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:34:15.976894 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-bb2bf391-6a47-4e64-9a09-b94cf02e5720 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:34:15.978909 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-bb2bf391-6a47-4e64-9a09-b94cf02e5720 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:34:15.980221 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-bb2bf391-6a47-4e64-9a09-b94cf02e5720 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] 10.222.0.46 "GET /compute/v2.1/servers/e69d4892-0a83-4d51-8ffd-904f1050907d" status: 200 len: 1407 microversion: 2.20 time: 0.256034 Aug 04 05:34:15.981260 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 464/916] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Aug 4 05:34:15 2022] GET /compute/v2.1/servers/e69d4892-0a83-4d51-8ffd-904f1050907d => generated 1407 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 05:34:17.008052 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-93af6f2c-f39c-4b8e-93d8-ea7015b06a73 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:34:17.011875 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-93af6f2c-f39c-4b8e-93d8-ea7015b06a73 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] [instance: e69d4892-0a83-4d51-8ffd-904f1050907d] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:34:17.021938 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG dbcounter [-] [118476] Writing DB stats nova_cell0:SELECT=2 {{(pid=118476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:34:17.024032 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG dbcounter [-] [118476] Writing DB stats nova_cell0:SELECT=6 {{(pid=118476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:34:17.031470 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-93af6f2c-f39c-4b8e-93d8-ea7015b06a73 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:34:17.032192 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-93af6f2c-f39c-4b8e-93d8-ea7015b06a73 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:34:17.033619 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-93af6f2c-f39c-4b8e-93d8-ea7015b06a73 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:34:17.034602 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-93af6f2c-f39c-4b8e-93d8-ea7015b06a73 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:34:17.203973 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG dbcounter [-] [118477] Writing DB stats nova_cell0:SELECT=6 {{(pid=118477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:34:17.209384 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [req-e37b761a-a273-4adb-9bbc-8199c98a1fee req-a33566ce-e5ca-4209-9a0e-87349026f5e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e69d4892-0a83-4d51-8ffd-904f1050907d", "name": "network-vif-plugged", "status": "completed", "tag": "846d125f-c82c-42db-8ed7-fe055882b03c"}]} {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:34:17.228847 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [req-e37b761a-a273-4adb-9bbc-8199c98a1fee req-a33566ce-e5ca-4209-9a0e-87349026f5e3 service nova] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:34:17.229297 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [req-e37b761a-a273-4adb-9bbc-8199c98a1fee req-a33566ce-e5ca-4209-9a0e-87349026f5e3 service nova] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:34:17.250400 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.compute.server_external_events [req-e37b761a-a273-4adb-9bbc-8199c98a1fee req-a33566ce-e5ca-4209-9a0e-87349026f5e3 service nova] Creating event network-vif-plugged:846d125f-c82c-42db-8ed7-fe055882b03c for instance e69d4892-0a83-4d51-8ffd-904f1050907d on hv-cinder-85207 Aug 04 05:34:17.260348 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [req-e37b761a-a273-4adb-9bbc-8199c98a1fee req-a33566ce-e5ca-4209-9a0e-87349026f5e3 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057698 Aug 04 05:34:17.260990 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 465/917] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Aug 4 05:34:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:34:17.267350 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-93af6f2c-f39c-4b8e-93d8-ea7015b06a73 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:34:17.272267 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-93af6f2c-f39c-4b8e-93d8-ea7015b06a73 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:34:17.273984 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-93af6f2c-f39c-4b8e-93d8-ea7015b06a73 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:34:17.275222 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-93af6f2c-f39c-4b8e-93d8-ea7015b06a73 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] 10.222.0.46 "GET /compute/v2.1/servers/e69d4892-0a83-4d51-8ffd-904f1050907d" status: 200 len: 1407 microversion: 2.20 time: 0.274948 Aug 04 05:34:17.275837 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 453/918] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Aug 4 05:34:16 2022] GET /compute/v2.1/servers/e69d4892-0a83-4d51-8ffd-904f1050907d => generated 1407 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 05:34:18.304150 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-dd015502-fde0-45e5-a538-999153d8228d tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:34:18.304970 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-dd015502-fde0-45e5-a538-999153d8228d tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] [instance: e69d4892-0a83-4d51-8ffd-904f1050907d] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:34:18.311470 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-dd015502-fde0-45e5-a538-999153d8228d tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:34:18.312129 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-dd015502-fde0-45e5-a538-999153d8228d tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:34:18.312980 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-dd015502-fde0-45e5-a538-999153d8228d tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:34:18.313490 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-dd015502-fde0-45e5-a538-999153d8228d tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:34:18.518963 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-dd015502-fde0-45e5-a538-999153d8228d tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:34:18.527791 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-dd015502-fde0-45e5-a538-999153d8228d tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:34:18.529287 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-dd015502-fde0-45e5-a538-999153d8228d tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:34:18.531174 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-dd015502-fde0-45e5-a538-999153d8228d tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] 10.222.0.46 "GET /compute/v2.1/servers/e69d4892-0a83-4d51-8ffd-904f1050907d" status: 200 len: 1407 microversion: 2.20 time: 0.233812 Aug 04 05:34:18.532375 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 466/919] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Aug 4 05:34:18 2022] GET /compute/v2.1/servers/e69d4892-0a83-4d51-8ffd-904f1050907d => generated 1407 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 05:34:19.554026 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-60219177-729c-444f-b865-c0db17747cc0 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:34:19.555345 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-60219177-729c-444f-b865-c0db17747cc0 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] [instance: e69d4892-0a83-4d51-8ffd-904f1050907d] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:34:19.563692 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-60219177-729c-444f-b865-c0db17747cc0 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:34:19.564143 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-60219177-729c-444f-b865-c0db17747cc0 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:34:19.564927 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-60219177-729c-444f-b865-c0db17747cc0 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:34:19.565534 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-60219177-729c-444f-b865-c0db17747cc0 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:34:19.775654 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-60219177-729c-444f-b865-c0db17747cc0 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:34:19.798528 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-60219177-729c-444f-b865-c0db17747cc0 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:34:19.800151 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-60219177-729c-444f-b865-c0db17747cc0 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:34:19.801673 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-60219177-729c-444f-b865-c0db17747cc0 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] 10.222.0.46 "GET /compute/v2.1/servers/e69d4892-0a83-4d51-8ffd-904f1050907d" status: 200 len: 1599 microversion: 2.20 time: 0.251900 Aug 04 05:34:19.802453 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 454/920] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Aug 4 05:34:19 2022] GET /compute/v2.1/servers/e69d4892-0a83-4d51-8ffd-904f1050907d => generated 1599 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 05:34:19.826590 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-c4122d58-bf4b-437a-918b-d72ac099ba18 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:34:19.831350 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-c4122d58-bf4b-437a-918b-d72ac099ba18 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] [instance: e69d4892-0a83-4d51-8ffd-904f1050907d] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:34:19.837805 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-c4122d58-bf4b-437a-918b-d72ac099ba18 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:34:19.838462 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-c4122d58-bf4b-437a-918b-d72ac099ba18 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:34:19.839344 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-c4122d58-bf4b-437a-918b-d72ac099ba18 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:34:19.840021 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-c4122d58-bf4b-437a-918b-d72ac099ba18 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:34:19.959368 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-c4122d58-bf4b-437a-918b-d72ac099ba18 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] 10.222.0.46 "GET /compute/v2.1/servers/e69d4892-0a83-4d51-8ffd-904f1050907d/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.129912 Aug 04 05:34:19.959368 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 467/921] 10.222.0.46 () {60 vars in 1316 bytes} [Thu Aug 4 05:34:19 2022] GET /compute/v2.1/servers/e69d4892-0a83-4d51-8ffd-904f1050907d/os-interface => generated 284 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 05:34:21.508767 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [req-572b61fb-5fb4-4d09-97df-6e28c99ccc6e req-bdc3a22c-7372-4941-ab3e-d798b6eabc6d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e69d4892-0a83-4d51-8ffd-904f1050907d", "tag": "846d125f-c82c-42db-8ed7-fe055882b03c"}]} {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:34:21.523020 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [req-572b61fb-5fb4-4d09-97df-6e28c99ccc6e req-bdc3a22c-7372-4941-ab3e-d798b6eabc6d service nova] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:34:21.523470 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [req-572b61fb-5fb4-4d09-97df-6e28c99ccc6e req-bdc3a22c-7372-4941-ab3e-d798b6eabc6d service nova] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:34:21.540800 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.compute.server_external_events [req-572b61fb-5fb4-4d09-97df-6e28c99ccc6e req-bdc3a22c-7372-4941-ab3e-d798b6eabc6d service nova] Creating event network-changed:846d125f-c82c-42db-8ed7-fe055882b03c for instance e69d4892-0a83-4d51-8ffd-904f1050907d on hv-cinder-85207 Aug 04 05:34:21.548667 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [req-572b61fb-5fb4-4d09-97df-6e28c99ccc6e req-bdc3a22c-7372-4941-ab3e-d798b6eabc6d service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043528 Aug 04 05:34:21.549635 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 455/922] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Aug 4 05:34:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:34:24.433459 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-fc588aea-5176-42a5-8343-b9bd767e8708 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Action: 'create', calling method: .version_select at 0x7f147547a310>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1497229411", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP/wX4lDhU8vZHSTUlNymcU8XXzBw58+SKsLl3XcKLuWFA9Z9RKQi50Ik8FAU/CNjnlfjAi3hjRAJ4aFcpyE7uwBfzsD9nysi0lg1fGgwMKdDlycYHNv+U20X7miLtcyiw=="}} {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:34:24.448858 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.quota [None req-fc588aea-5176-42a5-8343-b9bd767e8708 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Getting quotas for project c37bea771e9a4c26a19ff2ea9ed9d9b4. Resources: {'key_pairs'} {{(pid=118477) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 05:34:24.453409 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.quota [None req-fc588aea-5176-42a5-8343-b9bd767e8708 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Getting quotas for user 5ffe04946139486bb4b976cb0503e0aa and project c37bea771e9a4c26a19ff2ea9ed9d9b4. Resources: {'key_pairs'} {{(pid=118477) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 05:34:24.539294 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-fc588aea-5176-42a5-8343-b9bd767e8708 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.298520 Aug 04 05:34:24.539890 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 468/923] 10.222.0.46 () {60 vars in 1159 bytes} [Thu Aug 4 05:34:24 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:34:42.856688 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG dbcounter [-] [118476] Writing DB stats nova_api:SELECT=28,nova_api:INSERT=3 {{(pid=118476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:34:42.857595 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG dbcounter [-] [118476] Writing DB stats nova_cell1:SELECT=64 {{(pid=118476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:34:42.861670 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-02ae92f8-45d1-4a68-9a82-416d38ad39b7 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1061874035", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1497229411", "security_groups": [{"name": "tempest-secgroup-smoke-457367990"}], "block_device_mapping_v2": [{"uuid": "052f4806-21d9-4e10-887c-eaab09104132", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "999bb983-d3f9-4c98-9b4a-52666f821973"}]}} {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:34:42.975517 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.network.neutron [None req-02ae92f8-45d1-4a68-9a82-416d38ad39b7 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] validate_networks() for [('999bb983-d3f9-4c98-9b4a-52666f821973', None, None, None, None, None)] {{(pid=118476) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 05:34:43.344546 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.virt.hardware [None req-02ae92f8-45d1-4a68-9a82-416d38ad39b7 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Flavor limits 0:0:0 {{(pid=118476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 05:34:43.345035 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.virt.hardware [None req-02ae92f8-45d1-4a68-9a82-416d38ad39b7 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Image limits 0:0:0 {{(pid=118476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 05:34:43.345446 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.virt.hardware [None req-02ae92f8-45d1-4a68-9a82-416d38ad39b7 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Flavor pref 0:0:0 {{(pid=118476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 05:34:43.345853 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.virt.hardware [None req-02ae92f8-45d1-4a68-9a82-416d38ad39b7 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Image pref 0:0:0 {{(pid=118476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 05:34:43.346262 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.virt.hardware [None req-02ae92f8-45d1-4a68-9a82-416d38ad39b7 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 05:34:43.355148 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-02ae92f8-45d1-4a68-9a82-416d38ad39b7 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:34:43.355593 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-02ae92f8-45d1-4a68-9a82-416d38ad39b7 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:34:43.356390 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-02ae92f8-45d1-4a68-9a82-416d38ad39b7 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:34:43.356825 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-02ae92f8-45d1-4a68-9a82-416d38ad39b7 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:34:43.373318 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.quota [None req-02ae92f8-45d1-4a68-9a82-416d38ad39b7 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Getting quotas for project c37bea771e9a4c26a19ff2ea9ed9d9b4. Resources: {'instances', 'cores', 'ram'} {{(pid=118476) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 05:34:43.377197 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.quota [None req-02ae92f8-45d1-4a68-9a82-416d38ad39b7 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Getting quotas for user 5ffe04946139486bb4b976cb0503e0aa and project c37bea771e9a4c26a19ff2ea9ed9d9b4. Resources: {'instances', 'cores', 'ram'} {{(pid=118476) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 05:34:43.444651 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-02ae92f8-45d1-4a68-9a82-416d38ad39b7 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Going to run 1 instances... {{(pid=118476) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 05:34:43.447125 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-02ae92f8-45d1-4a68-9a82-416d38ad39b7 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] [instance: 42569e98-c703-4b76-8988-47029f786567] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='052f4806-21d9-4e10-887c-eaab09104132',volume_size=None,volume_type=None)] {{(pid=118476) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 05:34:43.798220 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-02ae92f8-45d1-4a68-9a82-416d38ad39b7 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.942862 Aug 04 05:34:43.799079 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 456/924] 10.222.0.46 () {60 vars in 1147 bytes} [Thu Aug 4 05:34:42 2022] POST /compute/v2.1/servers => generated 405 bytes in 944 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 05:34:43.807910 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG dbcounter [-] [118477] Writing DB stats nova_cell1:SELECT=54 {{(pid=118477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:34:43.808682 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG dbcounter [-] [118477] Writing DB stats nova_cell0:SELECT=4 {{(pid=118477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:34:43.809430 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG dbcounter [-] [118477] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=2 {{(pid=118477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:34:43.813489 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-ef0a2820-5e37-418a-925c-57eb1a4ef179 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:34:43.818691 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-ef0a2820-5e37-418a-925c-57eb1a4ef179 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] [instance: 42569e98-c703-4b76-8988-47029f786567] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:34:43.875291 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-ef0a2820-5e37-418a-925c-57eb1a4ef179 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ffe04946139486bb4b976cb0503e0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c37bea771e9a4c26a19ff2ea9ed9d9b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:34:43.882228 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-ef0a2820-5e37-418a-925c-57eb1a4ef179 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] 10.222.0.46 "GET /compute/v2.1/servers/42569e98-c703-4b76-8988-47029f786567" status: 200 len: 1095 microversion: 2.1 time: 0.075760 Aug 04 05:34:43.883441 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 469/925] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:34:43 2022] GET /compute/v2.1/servers/42569e98-c703-4b76-8988-47029f786567 => generated 1095 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:34:44.903318 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-0e152eca-19ea-4839-b44a-0216b57a3924 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:34:44.908630 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-0e152eca-19ea-4839-b44a-0216b57a3924 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] [instance: 42569e98-c703-4b76-8988-47029f786567] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:34:44.912219 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-0e152eca-19ea-4839-b44a-0216b57a3924 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:34:44.912670 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-0e152eca-19ea-4839-b44a-0216b57a3924 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:34:44.913433 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-0e152eca-19ea-4839-b44a-0216b57a3924 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:34:44.913867 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-0e152eca-19ea-4839-b44a-0216b57a3924 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:34:44.974920 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-0e152eca-19ea-4839-b44a-0216b57a3924 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ffe04946139486bb4b976cb0503e0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c37bea771e9a4c26a19ff2ea9ed9d9b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:34:44.982348 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-0e152eca-19ea-4839-b44a-0216b57a3924 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] 10.222.0.46 "GET /compute/v2.1/servers/42569e98-c703-4b76-8988-47029f786567" status: 200 len: 1145 microversion: 2.1 time: 0.083158 Aug 04 05:34:44.982929 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 457/926] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:34:44 2022] GET /compute/v2.1/servers/42569e98-c703-4b76-8988-47029f786567 => generated 1145 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:34:46.004703 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-8893732c-8bed-460c-a1f3-81bc96f1be69 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:34:46.005305 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-8893732c-8bed-460c-a1f3-81bc96f1be69 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] [instance: 42569e98-c703-4b76-8988-47029f786567] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:34:46.012348 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-8893732c-8bed-460c-a1f3-81bc96f1be69 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:34:46.016766 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-8893732c-8bed-460c-a1f3-81bc96f1be69 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:34:46.016766 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-8893732c-8bed-460c-a1f3-81bc96f1be69 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:34:46.016766 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-8893732c-8bed-460c-a1f3-81bc96f1be69 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:34:46.091459 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-8893732c-8bed-460c-a1f3-81bc96f1be69 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ffe04946139486bb4b976cb0503e0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c37bea771e9a4c26a19ff2ea9ed9d9b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:34:46.099498 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-8893732c-8bed-460c-a1f3-81bc96f1be69 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] 10.222.0.46 "GET /compute/v2.1/servers/42569e98-c703-4b76-8988-47029f786567" status: 200 len: 1201 microversion: 2.1 time: 0.098816 Aug 04 05:34:46.099973 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 470/927] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:34:45 2022] GET /compute/v2.1/servers/42569e98-c703-4b76-8988-47029f786567 => generated 1201 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:34:47.120458 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-892fde00-9822-4e64-8542-8c8b734d9f42 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:34:47.123218 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-892fde00-9822-4e64-8542-8c8b734d9f42 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] [instance: 42569e98-c703-4b76-8988-47029f786567] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:34:47.128371 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-892fde00-9822-4e64-8542-8c8b734d9f42 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:34:47.128865 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-892fde00-9822-4e64-8542-8c8b734d9f42 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:34:47.129772 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-892fde00-9822-4e64-8542-8c8b734d9f42 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:34:47.130220 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-892fde00-9822-4e64-8542-8c8b734d9f42 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:34:47.307607 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-892fde00-9822-4e64-8542-8c8b734d9f42 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ffe04946139486bb4b976cb0503e0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c37bea771e9a4c26a19ff2ea9ed9d9b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:34:47.314968 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-892fde00-9822-4e64-8542-8c8b734d9f42 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] 10.222.0.46 "GET /compute/v2.1/servers/42569e98-c703-4b76-8988-47029f786567" status: 200 len: 1278 microversion: 2.1 time: 0.198503 Aug 04 05:34:47.315537 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 458/928] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:34:47 2022] GET /compute/v2.1/servers/42569e98-c703-4b76-8988-47029f786567 => generated 1278 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:34:47.650731 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [req-3be03c5a-2204-4899-a5f8-820c7f1d2bc1 req-ef6cd81d-6887-44dd-912b-a5e72bae56aa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "42569e98-c703-4b76-8988-47029f786567", "tag": "2448f876-6800-42cf-9a97-b79c8970b481"}]} {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:34:47.662081 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [req-3be03c5a-2204-4899-a5f8-820c7f1d2bc1 req-ef6cd81d-6887-44dd-912b-a5e72bae56aa service nova] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:34:47.662552 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [req-3be03c5a-2204-4899-a5f8-820c7f1d2bc1 req-ef6cd81d-6887-44dd-912b-a5e72bae56aa service nova] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:34:47.674014 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.compute.server_external_events [req-3be03c5a-2204-4899-a5f8-820c7f1d2bc1 req-ef6cd81d-6887-44dd-912b-a5e72bae56aa service nova] Creating event network-changed:2448f876-6800-42cf-9a97-b79c8970b481 for instance 42569e98-c703-4b76-8988-47029f786567 on hv-cinder-85207 Aug 04 05:34:47.680184 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [req-3be03c5a-2204-4899-a5f8-820c7f1d2bc1 req-ef6cd81d-6887-44dd-912b-a5e72bae56aa service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032927 Aug 04 05:34:47.680788 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 471/929] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Aug 4 05:34:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:34:48.337167 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-47244867-1c9a-4e75-acbc-09db9d3dfb7e tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:34:48.337774 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-47244867-1c9a-4e75-acbc-09db9d3dfb7e tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] [instance: 42569e98-c703-4b76-8988-47029f786567] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:34:48.344507 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-47244867-1c9a-4e75-acbc-09db9d3dfb7e tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:34:48.344955 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-47244867-1c9a-4e75-acbc-09db9d3dfb7e tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:34:48.345727 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-47244867-1c9a-4e75-acbc-09db9d3dfb7e tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:34:48.346206 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-47244867-1c9a-4e75-acbc-09db9d3dfb7e tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:34:48.515223 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-47244867-1c9a-4e75-acbc-09db9d3dfb7e tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ffe04946139486bb4b976cb0503e0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c37bea771e9a4c26a19ff2ea9ed9d9b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:34:48.520047 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-47244867-1c9a-4e75-acbc-09db9d3dfb7e tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] 10.222.0.46 "GET /compute/v2.1/servers/42569e98-c703-4b76-8988-47029f786567" status: 200 len: 1266 microversion: 2.1 time: 0.187058 Aug 04 05:34:48.520788 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 459/930] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:34:48 2022] GET /compute/v2.1/servers/42569e98-c703-4b76-8988-47029f786567 => generated 1266 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:34:49.545403 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-cc81dc99-f612-423e-a82c-c76c917cb8c3 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:34:49.546133 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-cc81dc99-f612-423e-a82c-c76c917cb8c3 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] [instance: 42569e98-c703-4b76-8988-47029f786567] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:34:49.553458 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-cc81dc99-f612-423e-a82c-c76c917cb8c3 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:34:49.553883 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-cc81dc99-f612-423e-a82c-c76c917cb8c3 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:34:49.554664 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-cc81dc99-f612-423e-a82c-c76c917cb8c3 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:34:49.555095 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-cc81dc99-f612-423e-a82c-c76c917cb8c3 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:34:49.685769 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-cc81dc99-f612-423e-a82c-c76c917cb8c3 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ffe04946139486bb4b976cb0503e0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c37bea771e9a4c26a19ff2ea9ed9d9b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:34:49.694077 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-cc81dc99-f612-423e-a82c-c76c917cb8c3 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] 10.222.0.46 "GET /compute/v2.1/servers/42569e98-c703-4b76-8988-47029f786567" status: 200 len: 1266 microversion: 2.1 time: 0.153040 Aug 04 05:34:49.697668 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 472/931] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:34:49 2022] GET /compute/v2.1/servers/42569e98-c703-4b76-8988-47029f786567 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:34:50.715191 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-9d39824a-d7ba-4fe9-9081-eeadd7708e01 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:34:50.715800 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-9d39824a-d7ba-4fe9-9081-eeadd7708e01 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] [instance: 42569e98-c703-4b76-8988-47029f786567] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:34:50.723040 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-9d39824a-d7ba-4fe9-9081-eeadd7708e01 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:34:50.723496 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-9d39824a-d7ba-4fe9-9081-eeadd7708e01 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:34:50.724282 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-9d39824a-d7ba-4fe9-9081-eeadd7708e01 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:34:50.724720 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-9d39824a-d7ba-4fe9-9081-eeadd7708e01 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:34:50.857363 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-9d39824a-d7ba-4fe9-9081-eeadd7708e01 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ffe04946139486bb4b976cb0503e0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c37bea771e9a4c26a19ff2ea9ed9d9b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:34:50.865896 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-9d39824a-d7ba-4fe9-9081-eeadd7708e01 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] 10.222.0.46 "GET /compute/v2.1/servers/42569e98-c703-4b76-8988-47029f786567" status: 200 len: 1266 microversion: 2.1 time: 0.154527 Aug 04 05:34:50.866498 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 460/932] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:34:50 2022] GET /compute/v2.1/servers/42569e98-c703-4b76-8988-47029f786567 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:34:51.887283 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-df6749ea-1866-4b7c-acf1-9271057c912a tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:34:51.887879 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-df6749ea-1866-4b7c-acf1-9271057c912a tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] [instance: 42569e98-c703-4b76-8988-47029f786567] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:34:51.894422 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-df6749ea-1866-4b7c-acf1-9271057c912a tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:34:51.894991 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-df6749ea-1866-4b7c-acf1-9271057c912a tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:34:51.895872 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-df6749ea-1866-4b7c-acf1-9271057c912a tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:34:51.896306 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-df6749ea-1866-4b7c-acf1-9271057c912a tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:34:52.028730 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-df6749ea-1866-4b7c-acf1-9271057c912a tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ffe04946139486bb4b976cb0503e0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c37bea771e9a4c26a19ff2ea9ed9d9b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:34:52.036836 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-df6749ea-1866-4b7c-acf1-9271057c912a tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] 10.222.0.46 "GET /compute/v2.1/servers/42569e98-c703-4b76-8988-47029f786567" status: 200 len: 1266 microversion: 2.1 time: 0.153437 Aug 04 05:34:52.037411 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 473/933] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:34:51 2022] GET /compute/v2.1/servers/42569e98-c703-4b76-8988-47029f786567 => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:34:53.058235 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-aa3e9594-28e8-4230-a2ae-f201be22d4b0 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:34:53.058987 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-aa3e9594-28e8-4230-a2ae-f201be22d4b0 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] [instance: 42569e98-c703-4b76-8988-47029f786567] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:34:53.065516 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-aa3e9594-28e8-4230-a2ae-f201be22d4b0 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:34:53.065963 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-aa3e9594-28e8-4230-a2ae-f201be22d4b0 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:34:53.066899 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-aa3e9594-28e8-4230-a2ae-f201be22d4b0 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:34:53.068108 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-aa3e9594-28e8-4230-a2ae-f201be22d4b0 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:34:53.209814 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-aa3e9594-28e8-4230-a2ae-f201be22d4b0 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ffe04946139486bb4b976cb0503e0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c37bea771e9a4c26a19ff2ea9ed9d9b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:34:53.216620 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-aa3e9594-28e8-4230-a2ae-f201be22d4b0 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] 10.222.0.46 "GET /compute/v2.1/servers/42569e98-c703-4b76-8988-47029f786567" status: 200 len: 1266 microversion: 2.1 time: 0.162385 Aug 04 05:34:53.217200 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 461/934] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:34:53 2022] GET /compute/v2.1/servers/42569e98-c703-4b76-8988-47029f786567 => generated 1266 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:34:54.238637 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-b6d1bfec-a8d5-4454-a91e-ce5aa3b12cc4 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:34:54.240339 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-b6d1bfec-a8d5-4454-a91e-ce5aa3b12cc4 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] [instance: 42569e98-c703-4b76-8988-47029f786567] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:34:54.242434 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG dbcounter [-] [118477] Writing DB stats nova_cell0:SELECT=2 {{(pid=118477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:34:54.247547 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-b6d1bfec-a8d5-4454-a91e-ce5aa3b12cc4 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:34:54.247995 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-b6d1bfec-a8d5-4454-a91e-ce5aa3b12cc4 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:34:54.248817 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-b6d1bfec-a8d5-4454-a91e-ce5aa3b12cc4 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:34:54.249266 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-b6d1bfec-a8d5-4454-a91e-ce5aa3b12cc4 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:34:54.385993 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-b6d1bfec-a8d5-4454-a91e-ce5aa3b12cc4 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ffe04946139486bb4b976cb0503e0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c37bea771e9a4c26a19ff2ea9ed9d9b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:34:54.393531 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-b6d1bfec-a8d5-4454-a91e-ce5aa3b12cc4 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] 10.222.0.46 "GET /compute/v2.1/servers/42569e98-c703-4b76-8988-47029f786567" status: 200 len: 1266 microversion: 2.1 time: 0.159016 Aug 04 05:34:54.394097 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 474/935] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:34:54 2022] GET /compute/v2.1/servers/42569e98-c703-4b76-8988-47029f786567 => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:34:55.415456 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-5d13ab6b-ccb0-4d6c-a2ba-6477986be16c tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:34:55.416072 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-5d13ab6b-ccb0-4d6c-a2ba-6477986be16c tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] [instance: 42569e98-c703-4b76-8988-47029f786567] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:34:55.417934 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG dbcounter [-] [118476] Writing DB stats nova_cell0:SELECT=2 {{(pid=118476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:34:55.418634 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG dbcounter [-] [118476] Writing DB stats nova_cell0:SELECT=6 {{(pid=118476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:34:55.424045 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-5d13ab6b-ccb0-4d6c-a2ba-6477986be16c tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:34:55.424501 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-5d13ab6b-ccb0-4d6c-a2ba-6477986be16c tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:34:55.425287 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-5d13ab6b-ccb0-4d6c-a2ba-6477986be16c tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:34:55.425731 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-5d13ab6b-ccb0-4d6c-a2ba-6477986be16c tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:34:55.565381 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-5d13ab6b-ccb0-4d6c-a2ba-6477986be16c tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ffe04946139486bb4b976cb0503e0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c37bea771e9a4c26a19ff2ea9ed9d9b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:34:55.573080 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-5d13ab6b-ccb0-4d6c-a2ba-6477986be16c tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] 10.222.0.46 "GET /compute/v2.1/servers/42569e98-c703-4b76-8988-47029f786567" status: 200 len: 1266 microversion: 2.1 time: 0.161559 Aug 04 05:34:55.573654 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 462/936] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:34:55 2022] GET /compute/v2.1/servers/42569e98-c703-4b76-8988-47029f786567 => generated 1266 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:34:56.593648 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-5166c4b0-4e48-46bb-9d31-fea0f5cd714c tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:34:56.594244 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-5166c4b0-4e48-46bb-9d31-fea0f5cd714c tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] [instance: 42569e98-c703-4b76-8988-47029f786567] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:34:56.600195 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-5166c4b0-4e48-46bb-9d31-fea0f5cd714c tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:34:56.600633 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-5166c4b0-4e48-46bb-9d31-fea0f5cd714c tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:34:56.602287 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-5166c4b0-4e48-46bb-9d31-fea0f5cd714c tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:34:56.602740 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-5166c4b0-4e48-46bb-9d31-fea0f5cd714c tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:34:56.737618 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-5166c4b0-4e48-46bb-9d31-fea0f5cd714c tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ffe04946139486bb4b976cb0503e0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c37bea771e9a4c26a19ff2ea9ed9d9b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:34:56.745580 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-5166c4b0-4e48-46bb-9d31-fea0f5cd714c tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] 10.222.0.46 "GET /compute/v2.1/servers/42569e98-c703-4b76-8988-47029f786567" status: 200 len: 1266 microversion: 2.1 time: 0.156089 Aug 04 05:34:56.746151 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 475/937] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:34:56 2022] GET /compute/v2.1/servers/42569e98-c703-4b76-8988-47029f786567 => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:34:57.767039 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-3f565271-3c5e-4dad-bb70-f97c332247a4 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:34:57.767678 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-3f565271-3c5e-4dad-bb70-f97c332247a4 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] [instance: 42569e98-c703-4b76-8988-47029f786567] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:34:57.774921 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-3f565271-3c5e-4dad-bb70-f97c332247a4 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:34:57.775370 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-3f565271-3c5e-4dad-bb70-f97c332247a4 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:34:57.776132 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-3f565271-3c5e-4dad-bb70-f97c332247a4 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:34:57.776568 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-3f565271-3c5e-4dad-bb70-f97c332247a4 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:34:57.906503 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-3f565271-3c5e-4dad-bb70-f97c332247a4 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ffe04946139486bb4b976cb0503e0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c37bea771e9a4c26a19ff2ea9ed9d9b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:34:57.914089 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-3f565271-3c5e-4dad-bb70-f97c332247a4 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] 10.222.0.46 "GET /compute/v2.1/servers/42569e98-c703-4b76-8988-47029f786567" status: 200 len: 1266 microversion: 2.1 time: 0.150945 Aug 04 05:34:57.914702 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 463/938] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:34:57 2022] GET /compute/v2.1/servers/42569e98-c703-4b76-8988-47029f786567 => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:34:58.450114 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-0000cc7f-d14a-4fb8-85bc-1fcf210ea7ea tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:34:58.450688 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-0000cc7f-d14a-4fb8-85bc-1fcf210ea7ea tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] [instance: e69d4892-0a83-4d51-8ffd-904f1050907d] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:34:58.457071 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-0000cc7f-d14a-4fb8-85bc-1fcf210ea7ea tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:34:58.457506 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-0000cc7f-d14a-4fb8-85bc-1fcf210ea7ea tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:34:58.458256 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-0000cc7f-d14a-4fb8-85bc-1fcf210ea7ea tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:34:58.458708 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-0000cc7f-d14a-4fb8-85bc-1fcf210ea7ea tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:34:58.482926 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-0000cc7f-d14a-4fb8-85bc-1fcf210ea7ea tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] 10.222.0.46 "GET /compute/v2.1/servers/e69d4892-0a83-4d51-8ffd-904f1050907d/ips" status: 200 len: 151 microversion: 2.20 time: 0.036770 Aug 04 05:34:58.483500 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 476/939] 10.222.0.46 () {60 vars in 1289 bytes} [Thu Aug 4 05:34:58 2022] GET /compute/v2.1/servers/e69d4892-0a83-4d51-8ffd-904f1050907d/ips => generated 151 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 05:34:58.935212 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-f9e4b1e0-3411-48c9-8768-20e701cf910c tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:34:58.935983 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-f9e4b1e0-3411-48c9-8768-20e701cf910c tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] [instance: 42569e98-c703-4b76-8988-47029f786567] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:34:58.942519 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-f9e4b1e0-3411-48c9-8768-20e701cf910c tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:34:58.942960 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-f9e4b1e0-3411-48c9-8768-20e701cf910c tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:34:58.943877 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-f9e4b1e0-3411-48c9-8768-20e701cf910c tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:34:58.944315 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-f9e4b1e0-3411-48c9-8768-20e701cf910c tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:34:59.107412 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-f9e4b1e0-3411-48c9-8768-20e701cf910c tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ffe04946139486bb4b976cb0503e0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c37bea771e9a4c26a19ff2ea9ed9d9b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:34:59.112036 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-f9e4b1e0-3411-48c9-8768-20e701cf910c tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] 10.222.0.46 "GET /compute/v2.1/servers/42569e98-c703-4b76-8988-47029f786567" status: 200 len: 1266 microversion: 2.1 time: 0.180740 Aug 04 05:34:59.112630 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 464/940] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:34:58 2022] GET /compute/v2.1/servers/42569e98-c703-4b76-8988-47029f786567 => generated 1266 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 05:34:59.298095 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [req-e012bede-60b3-4b50-bef5-8c29d6ae4c00 req-3b9fa5b4-e33f-42c1-8fb0-40c9db02cd9c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "42569e98-c703-4b76-8988-47029f786567", "name": "network-vif-plugged", "status": "completed", "tag": "2448f876-6800-42cf-9a97-b79c8970b481"}]} {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:34:59.308851 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [req-e012bede-60b3-4b50-bef5-8c29d6ae4c00 req-3b9fa5b4-e33f-42c1-8fb0-40c9db02cd9c service nova] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:34:59.309292 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [req-e012bede-60b3-4b50-bef5-8c29d6ae4c00 req-3b9fa5b4-e33f-42c1-8fb0-40c9db02cd9c service nova] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:34:59.320554 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.compute.server_external_events [req-e012bede-60b3-4b50-bef5-8c29d6ae4c00 req-3b9fa5b4-e33f-42c1-8fb0-40c9db02cd9c service nova] Creating event network-vif-plugged:2448f876-6800-42cf-9a97-b79c8970b481 for instance 42569e98-c703-4b76-8988-47029f786567 on hv-cinder-85207 Aug 04 05:34:59.325683 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [req-e012bede-60b3-4b50-bef5-8c29d6ae4c00 req-3b9fa5b4-e33f-42c1-8fb0-40c9db02cd9c service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032908 Aug 04 05:34:59.326522 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 477/941] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Aug 4 05:34:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:35:00.134144 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-35a8efb8-cee4-4199-b892-ddb38a87d91e tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:35:00.134788 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-35a8efb8-cee4-4199-b892-ddb38a87d91e tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] [instance: 42569e98-c703-4b76-8988-47029f786567] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:35:00.141257 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-35a8efb8-cee4-4199-b892-ddb38a87d91e tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:35:00.141704 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-35a8efb8-cee4-4199-b892-ddb38a87d91e tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:35:00.144975 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-35a8efb8-cee4-4199-b892-ddb38a87d91e tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:35:00.144975 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-35a8efb8-cee4-4199-b892-ddb38a87d91e tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:35:00.278818 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-35a8efb8-cee4-4199-b892-ddb38a87d91e tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ffe04946139486bb4b976cb0503e0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c37bea771e9a4c26a19ff2ea9ed9d9b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:35:00.286396 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-35a8efb8-cee4-4199-b892-ddb38a87d91e tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] 10.222.0.46 "GET /compute/v2.1/servers/42569e98-c703-4b76-8988-47029f786567" status: 200 len: 1266 microversion: 2.1 time: 0.156834 Aug 04 05:35:00.286970 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 465/942] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:35:00 2022] GET /compute/v2.1/servers/42569e98-c703-4b76-8988-47029f786567 => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:35:00.610702 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-3a8978df-8c87-4921-83aa-21c1ca9fcc58 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:35:00.611308 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-3a8978df-8c87-4921-83aa-21c1ca9fcc58 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] [instance: e69d4892-0a83-4d51-8ffd-904f1050907d] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:35:00.617965 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-3a8978df-8c87-4921-83aa-21c1ca9fcc58 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:35:00.618431 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-3a8978df-8c87-4921-83aa-21c1ca9fcc58 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:35:00.619184 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-3a8978df-8c87-4921-83aa-21c1ca9fcc58 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:35:00.619613 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-3a8978df-8c87-4921-83aa-21c1ca9fcc58 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:35:00.643734 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.objects.instance [None req-3a8978df-8c87-4921-83aa-21c1ca9fcc58 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lazy-loading 'flavor' on Instance uuid e69d4892-0a83-4d51-8ffd-904f1050907d {{(pid=118477) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 05:35:01.261725 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-3a8978df-8c87-4921-83aa-21c1ca9fcc58 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] 10.222.0.46 "POST /compute/v2.1/servers/e69d4892-0a83-4d51-8ffd-904f1050907d/action" status: 202 len: 0 microversion: 2.20 time: 0.655596 Aug 04 05:35:01.262365 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 478/943] 10.222.0.46 () {62 vars in 1319 bytes} [Thu Aug 4 05:35:00 2022] POST /compute/v2.1/servers/e69d4892-0a83-4d51-8ffd-904f1050907d/action => generated 0 bytes in 657 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 04 05:35:01.270958 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-59acbe29-8a29-465f-9179-92fbbc079bb7 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:35:01.271571 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-59acbe29-8a29-465f-9179-92fbbc079bb7 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] [instance: e69d4892-0a83-4d51-8ffd-904f1050907d] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:35:01.279963 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-59acbe29-8a29-465f-9179-92fbbc079bb7 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:35:01.280404 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-59acbe29-8a29-465f-9179-92fbbc079bb7 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:35:01.281181 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-59acbe29-8a29-465f-9179-92fbbc079bb7 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:35:01.281612 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-59acbe29-8a29-465f-9179-92fbbc079bb7 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:35:01.309611 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-4ac1e5aa-7c90-4dd6-b9bc-74f33cb51e8e tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:35:01.310371 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-4ac1e5aa-7c90-4dd6-b9bc-74f33cb51e8e tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] [instance: 42569e98-c703-4b76-8988-47029f786567] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:35:01.316740 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-4ac1e5aa-7c90-4dd6-b9bc-74f33cb51e8e tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:35:01.317194 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-4ac1e5aa-7c90-4dd6-b9bc-74f33cb51e8e tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:35:01.317964 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-4ac1e5aa-7c90-4dd6-b9bc-74f33cb51e8e tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:35:01.318462 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-4ac1e5aa-7c90-4dd6-b9bc-74f33cb51e8e tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:35:01.495448 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-59acbe29-8a29-465f-9179-92fbbc079bb7 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:35:01.503655 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-59acbe29-8a29-465f-9179-92fbbc079bb7 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:35:01.505404 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-59acbe29-8a29-465f-9179-92fbbc079bb7 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:35:01.507434 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-59acbe29-8a29-465f-9179-92fbbc079bb7 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] 10.222.0.46 "GET /compute/v2.1/servers/e69d4892-0a83-4d51-8ffd-904f1050907d" status: 200 len: 1723 microversion: 2.20 time: 0.240068 Aug 04 05:35:01.508297 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 466/944] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Aug 4 05:35:01 2022] GET /compute/v2.1/servers/e69d4892-0a83-4d51-8ffd-904f1050907d => generated 1723 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 05:35:01.527155 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-4ac1e5aa-7c90-4dd6-b9bc-74f33cb51e8e tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ffe04946139486bb4b976cb0503e0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c37bea771e9a4c26a19ff2ea9ed9d9b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:35:01.535567 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-4ac1e5aa-7c90-4dd6-b9bc-74f33cb51e8e tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] 10.222.0.46 "GET /compute/v2.1/servers/42569e98-c703-4b76-8988-47029f786567" status: 200 len: 1266 microversion: 2.1 time: 0.230282 Aug 04 05:35:01.540879 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 479/945] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:35:01 2022] GET /compute/v2.1/servers/42569e98-c703-4b76-8988-47029f786567 => generated 1266 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 05:35:02.531827 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-95533407-147b-409a-b070-063b25cbda4b tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:35:02.532432 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-95533407-147b-409a-b070-063b25cbda4b tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] [instance: e69d4892-0a83-4d51-8ffd-904f1050907d] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:35:02.539165 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-95533407-147b-409a-b070-063b25cbda4b tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:35:02.539641 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-95533407-147b-409a-b070-063b25cbda4b tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:35:02.540404 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-95533407-147b-409a-b070-063b25cbda4b tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:35:02.540843 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-95533407-147b-409a-b070-063b25cbda4b tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:35:02.557598 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-5e0ab824-533a-49d6-96c4-06449d686118 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:35:02.558181 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-5e0ab824-533a-49d6-96c4-06449d686118 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] [instance: 42569e98-c703-4b76-8988-47029f786567] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:35:02.564663 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-5e0ab824-533a-49d6-96c4-06449d686118 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:35:02.565084 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-5e0ab824-533a-49d6-96c4-06449d686118 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:35:02.565898 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-5e0ab824-533a-49d6-96c4-06449d686118 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:35:02.566271 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-5e0ab824-533a-49d6-96c4-06449d686118 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:35:03.021521 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-95533407-147b-409a-b070-063b25cbda4b tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:35:03.027126 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-5e0ab824-533a-49d6-96c4-06449d686118 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ffe04946139486bb4b976cb0503e0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c37bea771e9a4c26a19ff2ea9ed9d9b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:35:03.030969 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-95533407-147b-409a-b070-063b25cbda4b tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:35:03.032511 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-95533407-147b-409a-b070-063b25cbda4b tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:35:03.033670 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-95533407-147b-409a-b070-063b25cbda4b tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] 10.222.0.46 "GET /compute/v2.1/servers/e69d4892-0a83-4d51-8ffd-904f1050907d" status: 200 len: 1723 microversion: 2.20 time: 0.505779 Aug 04 05:35:03.034227 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 467/946] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Aug 4 05:35:02 2022] GET /compute/v2.1/servers/e69d4892-0a83-4d51-8ffd-904f1050907d => generated 1723 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 05:35:03.034859 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-5e0ab824-533a-49d6-96c4-06449d686118 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] 10.222.0.46 "GET /compute/v2.1/servers/42569e98-c703-4b76-8988-47029f786567" status: 200 len: 1453 microversion: 2.1 time: 0.481629 Aug 04 05:35:03.035415 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 480/947] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:35:02 2022] GET /compute/v2.1/servers/42569e98-c703-4b76-8988-47029f786567 => generated 1453 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 05:35:03.055039 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-f8908323-61d9-4487-b618-986d8c285055 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:35:03.055643 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-f8908323-61d9-4487-b618-986d8c285055 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] [instance: 42569e98-c703-4b76-8988-47029f786567] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:35:03.061782 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-f8908323-61d9-4487-b618-986d8c285055 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:35:03.062229 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-f8908323-61d9-4487-b618-986d8c285055 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:35:03.063036 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-f8908323-61d9-4487-b618-986d8c285055 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:35:03.063468 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-f8908323-61d9-4487-b618-986d8c285055 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:35:03.205422 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-f8908323-61d9-4487-b618-986d8c285055 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ffe04946139486bb4b976cb0503e0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c37bea771e9a4c26a19ff2ea9ed9d9b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:35:03.214540 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-f8908323-61d9-4487-b618-986d8c285055 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] 10.222.0.46 "GET /compute/v2.1/servers/42569e98-c703-4b76-8988-47029f786567" status: 200 len: 1453 microversion: 2.1 time: 0.163168 Aug 04 05:35:03.215113 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 468/948] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:35:03 2022] GET /compute/v2.1/servers/42569e98-c703-4b76-8988-47029f786567 => generated 1453 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:35:04.056510 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-4ac0fd57-fb17-42f9-9e56-6e7ae0b82328 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:35:04.057124 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-4ac0fd57-fb17-42f9-9e56-6e7ae0b82328 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] [instance: e69d4892-0a83-4d51-8ffd-904f1050907d] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:35:04.063820 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-4ac0fd57-fb17-42f9-9e56-6e7ae0b82328 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:35:04.064266 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-4ac0fd57-fb17-42f9-9e56-6e7ae0b82328 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:35:04.065034 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-4ac0fd57-fb17-42f9-9e56-6e7ae0b82328 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:35:04.065466 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-4ac0fd57-fb17-42f9-9e56-6e7ae0b82328 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:35:04.306415 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-4ac0fd57-fb17-42f9-9e56-6e7ae0b82328 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:35:04.314416 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-4ac0fd57-fb17-42f9-9e56-6e7ae0b82328 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:35:04.315953 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-4ac0fd57-fb17-42f9-9e56-6e7ae0b82328 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:35:04.317111 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-4ac0fd57-fb17-42f9-9e56-6e7ae0b82328 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] 10.222.0.46 "GET /compute/v2.1/servers/e69d4892-0a83-4d51-8ffd-904f1050907d" status: 200 len: 1723 microversion: 2.20 time: 0.264550 Aug 04 05:35:04.317864 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 481/949] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Aug 4 05:35:04 2022] GET /compute/v2.1/servers/e69d4892-0a83-4d51-8ffd-904f1050907d => generated 1723 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 05:35:05.308394 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [req-b1b39def-9687-49c8-8914-80a1a32bbe0a req-842f7996-c364-4dbf-9d43-06a04226ff07 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "42569e98-c703-4b76-8988-47029f786567", "tag": "2448f876-6800-42cf-9a97-b79c8970b481"}]} {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:35:05.318566 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [req-b1b39def-9687-49c8-8914-80a1a32bbe0a req-842f7996-c364-4dbf-9d43-06a04226ff07 service nova] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:35:05.319105 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [req-b1b39def-9687-49c8-8914-80a1a32bbe0a req-842f7996-c364-4dbf-9d43-06a04226ff07 service nova] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:35:05.330769 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.compute.server_external_events [req-b1b39def-9687-49c8-8914-80a1a32bbe0a req-842f7996-c364-4dbf-9d43-06a04226ff07 service nova] Creating event network-changed:2448f876-6800-42cf-9a97-b79c8970b481 for instance 42569e98-c703-4b76-8988-47029f786567 on hv-cinder-85207 Aug 04 05:35:05.335820 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [req-b1b39def-9687-49c8-8914-80a1a32bbe0a req-842f7996-c364-4dbf-9d43-06a04226ff07 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031843 Aug 04 05:35:05.336573 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 469/950] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Aug 4 05:35:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:35:05.342236 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-d3614060-7d18-4701-b1b4-bf6e75951432 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:35:05.342881 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-d3614060-7d18-4701-b1b4-bf6e75951432 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] [instance: e69d4892-0a83-4d51-8ffd-904f1050907d] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:35:05.349448 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-d3614060-7d18-4701-b1b4-bf6e75951432 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:35:05.349894 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-d3614060-7d18-4701-b1b4-bf6e75951432 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:35:05.351497 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-d3614060-7d18-4701-b1b4-bf6e75951432 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:35:05.351986 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-d3614060-7d18-4701-b1b4-bf6e75951432 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:35:05.576642 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-d3614060-7d18-4701-b1b4-bf6e75951432 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:35:05.587932 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-d3614060-7d18-4701-b1b4-bf6e75951432 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:35:05.589745 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-d3614060-7d18-4701-b1b4-bf6e75951432 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:35:05.591214 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-d3614060-7d18-4701-b1b4-bf6e75951432 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] 10.222.0.46 "GET /compute/v2.1/servers/e69d4892-0a83-4d51-8ffd-904f1050907d" status: 200 len: 1723 microversion: 2.20 time: 0.253687 Aug 04 05:35:05.592102 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 482/951] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Aug 4 05:35:05 2022] GET /compute/v2.1/servers/e69d4892-0a83-4d51-8ffd-904f1050907d => generated 1723 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 05:35:06.617288 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-175da3ad-f3b2-4e80-bb3a-0e51392f62b8 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:35:06.618005 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-175da3ad-f3b2-4e80-bb3a-0e51392f62b8 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] [instance: e69d4892-0a83-4d51-8ffd-904f1050907d] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:35:06.624513 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-175da3ad-f3b2-4e80-bb3a-0e51392f62b8 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:35:06.625003 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-175da3ad-f3b2-4e80-bb3a-0e51392f62b8 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:35:06.625760 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-175da3ad-f3b2-4e80-bb3a-0e51392f62b8 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:35:06.626191 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-175da3ad-f3b2-4e80-bb3a-0e51392f62b8 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:35:06.763493 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-175da3ad-f3b2-4e80-bb3a-0e51392f62b8 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:35:06.769112 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-175da3ad-f3b2-4e80-bb3a-0e51392f62b8 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:35:06.770644 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-175da3ad-f3b2-4e80-bb3a-0e51392f62b8 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:35:06.771818 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-175da3ad-f3b2-4e80-bb3a-0e51392f62b8 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] 10.222.0.46 "GET /compute/v2.1/servers/e69d4892-0a83-4d51-8ffd-904f1050907d" status: 200 len: 1723 microversion: 2.20 time: 0.160605 Aug 04 05:35:06.772386 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 470/952] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Aug 4 05:35:06 2022] GET /compute/v2.1/servers/e69d4892-0a83-4d51-8ffd-904f1050907d => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 05:35:07.796236 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-8c3667cb-0557-4c3e-bcc3-b44c5bfbc172 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:35:07.796911 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-8c3667cb-0557-4c3e-bcc3-b44c5bfbc172 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] [instance: e69d4892-0a83-4d51-8ffd-904f1050907d] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:35:07.803707 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-8c3667cb-0557-4c3e-bcc3-b44c5bfbc172 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:35:07.804155 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-8c3667cb-0557-4c3e-bcc3-b44c5bfbc172 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:35:07.806359 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-8c3667cb-0557-4c3e-bcc3-b44c5bfbc172 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:35:07.806813 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-8c3667cb-0557-4c3e-bcc3-b44c5bfbc172 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:35:07.939467 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-8c3667cb-0557-4c3e-bcc3-b44c5bfbc172 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:35:07.948279 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-8c3667cb-0557-4c3e-bcc3-b44c5bfbc172 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:35:07.949770 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-8c3667cb-0557-4c3e-bcc3-b44c5bfbc172 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:35:07.950953 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-8c3667cb-0557-4c3e-bcc3-b44c5bfbc172 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] 10.222.0.46 "GET /compute/v2.1/servers/e69d4892-0a83-4d51-8ffd-904f1050907d" status: 200 len: 1723 microversion: 2.20 time: 0.158715 Aug 04 05:35:07.951662 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 483/953] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Aug 4 05:35:07 2022] GET /compute/v2.1/servers/e69d4892-0a83-4d51-8ffd-904f1050907d => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 05:35:08.974539 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-0f6a9c98-560c-4d41-8f44-31546eb21e7f tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:35:08.975154 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-0f6a9c98-560c-4d41-8f44-31546eb21e7f tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] [instance: e69d4892-0a83-4d51-8ffd-904f1050907d] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:35:08.982607 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-0f6a9c98-560c-4d41-8f44-31546eb21e7f tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:35:08.983055 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-0f6a9c98-560c-4d41-8f44-31546eb21e7f tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:35:08.983822 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-0f6a9c98-560c-4d41-8f44-31546eb21e7f tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:35:08.984259 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-0f6a9c98-560c-4d41-8f44-31546eb21e7f tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:35:09.119702 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-0f6a9c98-560c-4d41-8f44-31546eb21e7f tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:35:09.127697 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-0f6a9c98-560c-4d41-8f44-31546eb21e7f tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:35:09.129205 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-0f6a9c98-560c-4d41-8f44-31546eb21e7f tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:35:09.130378 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-0f6a9c98-560c-4d41-8f44-31546eb21e7f tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] 10.222.0.46 "GET /compute/v2.1/servers/e69d4892-0a83-4d51-8ffd-904f1050907d" status: 200 len: 1723 microversion: 2.20 time: 0.159814 Aug 04 05:35:09.130942 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 471/954] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Aug 4 05:35:08 2022] GET /compute/v2.1/servers/e69d4892-0a83-4d51-8ffd-904f1050907d => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 05:35:10.153932 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-3f4cea6a-9181-4c76-b09e-a47b24ba56f9 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:35:10.154574 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-3f4cea6a-9181-4c76-b09e-a47b24ba56f9 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] [instance: e69d4892-0a83-4d51-8ffd-904f1050907d] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:35:10.161186 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-3f4cea6a-9181-4c76-b09e-a47b24ba56f9 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:35:10.161632 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-3f4cea6a-9181-4c76-b09e-a47b24ba56f9 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:35:10.162419 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-3f4cea6a-9181-4c76-b09e-a47b24ba56f9 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:35:10.162866 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-3f4cea6a-9181-4c76-b09e-a47b24ba56f9 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:35:10.353899 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-3f4cea6a-9181-4c76-b09e-a47b24ba56f9 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:35:10.362104 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-3f4cea6a-9181-4c76-b09e-a47b24ba56f9 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:35:10.363649 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-3f4cea6a-9181-4c76-b09e-a47b24ba56f9 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:35:10.364809 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-3f4cea6a-9181-4c76-b09e-a47b24ba56f9 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] 10.222.0.46 "GET /compute/v2.1/servers/e69d4892-0a83-4d51-8ffd-904f1050907d" status: 200 len: 1723 microversion: 2.20 time: 0.215065 Aug 04 05:35:10.365357 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 484/955] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Aug 4 05:35:10 2022] GET /compute/v2.1/servers/e69d4892-0a83-4d51-8ffd-904f1050907d => generated 1723 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 05:35:11.388144 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-82b4a2d7-7c84-4498-b756-cedba8cbe567 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:35:11.388738 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-82b4a2d7-7c84-4498-b756-cedba8cbe567 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] [instance: e69d4892-0a83-4d51-8ffd-904f1050907d] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:35:11.395412 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-82b4a2d7-7c84-4498-b756-cedba8cbe567 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:35:11.395864 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-82b4a2d7-7c84-4498-b756-cedba8cbe567 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:35:11.396628 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-82b4a2d7-7c84-4498-b756-cedba8cbe567 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:35:11.397117 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-82b4a2d7-7c84-4498-b756-cedba8cbe567 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:35:11.579451 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-82b4a2d7-7c84-4498-b756-cedba8cbe567 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:35:11.588056 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-82b4a2d7-7c84-4498-b756-cedba8cbe567 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:35:11.589552 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-82b4a2d7-7c84-4498-b756-cedba8cbe567 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:35:11.590731 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-82b4a2d7-7c84-4498-b756-cedba8cbe567 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] 10.222.0.46 "GET /compute/v2.1/servers/e69d4892-0a83-4d51-8ffd-904f1050907d" status: 200 len: 1723 microversion: 2.20 time: 0.206546 Aug 04 05:35:11.591291 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 472/956] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Aug 4 05:35:11 2022] GET /compute/v2.1/servers/e69d4892-0a83-4d51-8ffd-904f1050907d => generated 1723 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 05:35:12.620794 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-d0cead8b-62de-4a53-bc1d-4a46010c1bdd tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:35:12.621377 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-d0cead8b-62de-4a53-bc1d-4a46010c1bdd tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] [instance: e69d4892-0a83-4d51-8ffd-904f1050907d] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:35:12.627955 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-d0cead8b-62de-4a53-bc1d-4a46010c1bdd tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:35:12.628395 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-d0cead8b-62de-4a53-bc1d-4a46010c1bdd tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:35:12.629150 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-d0cead8b-62de-4a53-bc1d-4a46010c1bdd tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:35:12.629579 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-d0cead8b-62de-4a53-bc1d-4a46010c1bdd tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:35:12.765001 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-d0cead8b-62de-4a53-bc1d-4a46010c1bdd tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:35:12.772916 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-d0cead8b-62de-4a53-bc1d-4a46010c1bdd tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:35:12.775143 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-d0cead8b-62de-4a53-bc1d-4a46010c1bdd tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:35:12.776312 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-d0cead8b-62de-4a53-bc1d-4a46010c1bdd tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] 10.222.0.46 "GET /compute/v2.1/servers/e69d4892-0a83-4d51-8ffd-904f1050907d" status: 200 len: 1744 microversion: 2.20 time: 0.160187 Aug 04 05:35:12.777129 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 485/957] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Aug 4 05:35:12 2022] GET /compute/v2.1/servers/e69d4892-0a83-4d51-8ffd-904f1050907d => generated 1744 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 05:35:13.799444 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-32df24dd-c9a9-4478-b3e8-fa9a275c6e4c tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:35:13.800027 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-32df24dd-c9a9-4478-b3e8-fa9a275c6e4c tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] [instance: e69d4892-0a83-4d51-8ffd-904f1050907d] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:35:13.802435 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG dbcounter [-] [118476] Writing DB stats nova_api:SELECT=48,nova_api:INSERT=3 {{(pid=118476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:35:13.807522 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-32df24dd-c9a9-4478-b3e8-fa9a275c6e4c tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:35:13.807968 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-32df24dd-c9a9-4478-b3e8-fa9a275c6e4c tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:35:13.808738 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-32df24dd-c9a9-4478-b3e8-fa9a275c6e4c tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:35:13.809170 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-32df24dd-c9a9-4478-b3e8-fa9a275c6e4c tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:35:13.811835 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG dbcounter [-] [118476] Writing DB stats nova_cell1:SELECT=95 {{(pid=118476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:35:13.950141 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-32df24dd-c9a9-4478-b3e8-fa9a275c6e4c tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:35:13.958252 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-32df24dd-c9a9-4478-b3e8-fa9a275c6e4c tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:35:13.959778 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-32df24dd-c9a9-4478-b3e8-fa9a275c6e4c tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:35:13.960947 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-32df24dd-c9a9-4478-b3e8-fa9a275c6e4c tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] 10.222.0.46 "GET /compute/v2.1/servers/e69d4892-0a83-4d51-8ffd-904f1050907d" status: 200 len: 1744 microversion: 2.20 time: 0.165576 Aug 04 05:35:13.962066 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 473/958] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Aug 4 05:35:13 2022] GET /compute/v2.1/servers/e69d4892-0a83-4d51-8ffd-904f1050907d => generated 1744 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 05:35:14.985504 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-8b77b1e3-432d-4297-b04d-0f7103a20051 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:35:14.988670 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-8b77b1e3-432d-4297-b04d-0f7103a20051 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] [instance: e69d4892-0a83-4d51-8ffd-904f1050907d] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:35:14.996107 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-8b77b1e3-432d-4297-b04d-0f7103a20051 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:35:14.997279 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-8b77b1e3-432d-4297-b04d-0f7103a20051 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:35:14.998915 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-8b77b1e3-432d-4297-b04d-0f7103a20051 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:35:14.998915 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-8b77b1e3-432d-4297-b04d-0f7103a20051 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:35:15.001606 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG dbcounter [-] [118477] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:35:15.210590 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-8b77b1e3-432d-4297-b04d-0f7103a20051 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:35:15.220785 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-8b77b1e3-432d-4297-b04d-0f7103a20051 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:35:15.222999 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-8b77b1e3-432d-4297-b04d-0f7103a20051 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:35:15.229835 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-8b77b1e3-432d-4297-b04d-0f7103a20051 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] 10.222.0.46 "GET /compute/v2.1/servers/e69d4892-0a83-4d51-8ffd-904f1050907d" status: 200 len: 1739 microversion: 2.20 time: 0.247973 Aug 04 05:35:15.231077 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 486/959] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Aug 4 05:35:14 2022] GET /compute/v2.1/servers/e69d4892-0a83-4d51-8ffd-904f1050907d => generated 1739 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 05:35:15.318552 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [req-ccf2b420-2765-4d71-b259-c7311eaec86d req-78cebcc2-5a7b-4268-bcb9-4299e5c63244 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e69d4892-0a83-4d51-8ffd-904f1050907d", "name": "network-vif-plugged", "status": "completed", "tag": "846d125f-c82c-42db-8ed7-fe055882b03c"}]} {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:35:15.334717 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [req-ccf2b420-2765-4d71-b259-c7311eaec86d req-78cebcc2-5a7b-4268-bcb9-4299e5c63244 service nova] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:35:15.335313 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [req-ccf2b420-2765-4d71-b259-c7311eaec86d req-78cebcc2-5a7b-4268-bcb9-4299e5c63244 service nova] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:35:15.347692 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.compute.server_external_events [req-ccf2b420-2765-4d71-b259-c7311eaec86d req-78cebcc2-5a7b-4268-bcb9-4299e5c63244 service nova] Creating event network-vif-plugged:846d125f-c82c-42db-8ed7-fe055882b03c for instance e69d4892-0a83-4d51-8ffd-904f1050907d on hv-cinder-85207 Aug 04 05:35:15.353536 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [req-ccf2b420-2765-4d71-b259-c7311eaec86d req-78cebcc2-5a7b-4268-bcb9-4299e5c63244 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038379 Aug 04 05:35:15.354292 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 474/960] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Aug 4 05:35:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:35:16.253574 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-c87ba64e-2436-4c43-b98c-394ffec07d3f tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:35:16.259504 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-c87ba64e-2436-4c43-b98c-394ffec07d3f tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] [instance: e69d4892-0a83-4d51-8ffd-904f1050907d] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:35:16.263627 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG dbcounter [-] [118477] Writing DB stats nova_api:SELECT=39 {{(pid=118477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:35:16.267982 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-c87ba64e-2436-4c43-b98c-394ffec07d3f tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:35:16.268434 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-c87ba64e-2436-4c43-b98c-394ffec07d3f tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:35:16.269202 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-c87ba64e-2436-4c43-b98c-394ffec07d3f tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:35:16.269633 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-c87ba64e-2436-4c43-b98c-394ffec07d3f tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:35:16.429641 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-c87ba64e-2436-4c43-b98c-394ffec07d3f tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:35:16.439851 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-c87ba64e-2436-4c43-b98c-394ffec07d3f tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:35:16.441366 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-c87ba64e-2436-4c43-b98c-394ffec07d3f tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:35:16.442565 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-c87ba64e-2436-4c43-b98c-394ffec07d3f tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] 10.222.0.46 "GET /compute/v2.1/servers/e69d4892-0a83-4d51-8ffd-904f1050907d" status: 200 len: 1739 microversion: 2.20 time: 0.193018 Aug 04 05:35:16.454336 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 487/961] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Aug 4 05:35:16 2022] GET /compute/v2.1/servers/e69d4892-0a83-4d51-8ffd-904f1050907d => generated 1739 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 05:35:17.467053 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-cb493397-eb6f-4b60-bda6-fc809ba67679 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:35:17.467658 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-cb493397-eb6f-4b60-bda6-fc809ba67679 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] [instance: e69d4892-0a83-4d51-8ffd-904f1050907d] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:35:17.475159 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-cb493397-eb6f-4b60-bda6-fc809ba67679 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:35:17.475603 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-cb493397-eb6f-4b60-bda6-fc809ba67679 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:35:17.476436 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-cb493397-eb6f-4b60-bda6-fc809ba67679 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:35:17.476873 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-cb493397-eb6f-4b60-bda6-fc809ba67679 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:35:17.630821 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-cb493397-eb6f-4b60-bda6-fc809ba67679 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:35:17.645611 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-cb493397-eb6f-4b60-bda6-fc809ba67679 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:35:17.647369 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-cb493397-eb6f-4b60-bda6-fc809ba67679 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:35:17.666325 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-cb493397-eb6f-4b60-bda6-fc809ba67679 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] 10.222.0.46 "GET /compute/v2.1/servers/e69d4892-0a83-4d51-8ffd-904f1050907d" status: 200 len: 1739 microversion: 2.20 time: 0.185990 Aug 04 05:35:17.666325 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 475/962] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Aug 4 05:35:17 2022] GET /compute/v2.1/servers/e69d4892-0a83-4d51-8ffd-904f1050907d => generated 1739 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 05:35:18.678846 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-22768852-01f5-416c-88b0-12a9d9c1d78b tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:35:18.682944 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-22768852-01f5-416c-88b0-12a9d9c1d78b tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] [instance: e69d4892-0a83-4d51-8ffd-904f1050907d] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:35:18.691124 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-22768852-01f5-416c-88b0-12a9d9c1d78b tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:35:18.691895 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-22768852-01f5-416c-88b0-12a9d9c1d78b tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:35:18.692873 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-22768852-01f5-416c-88b0-12a9d9c1d78b tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:35:18.693304 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-22768852-01f5-416c-88b0-12a9d9c1d78b tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:35:18.849407 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-22768852-01f5-416c-88b0-12a9d9c1d78b tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:35:18.860900 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-22768852-01f5-416c-88b0-12a9d9c1d78b tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:35:18.862635 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-22768852-01f5-416c-88b0-12a9d9c1d78b tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:35:18.863800 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-22768852-01f5-416c-88b0-12a9d9c1d78b tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] 10.222.0.46 "GET /compute/v2.1/servers/e69d4892-0a83-4d51-8ffd-904f1050907d" status: 200 len: 1739 microversion: 2.20 time: 0.188804 Aug 04 05:35:18.864569 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 488/963] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Aug 4 05:35:18 2022] GET /compute/v2.1/servers/e69d4892-0a83-4d51-8ffd-904f1050907d => generated 1739 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 05:35:19.890640 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-53375120-1bcd-441f-92b9-d357137bd7ac tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:35:19.892017 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-53375120-1bcd-441f-92b9-d357137bd7ac tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] [instance: e69d4892-0a83-4d51-8ffd-904f1050907d] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:35:19.900824 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-53375120-1bcd-441f-92b9-d357137bd7ac tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:35:19.902500 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-53375120-1bcd-441f-92b9-d357137bd7ac tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:35:19.904200 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-53375120-1bcd-441f-92b9-d357137bd7ac tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:35:19.904649 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-53375120-1bcd-441f-92b9-d357137bd7ac tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:35:20.062858 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-53375120-1bcd-441f-92b9-d357137bd7ac tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:35:20.077916 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-53375120-1bcd-441f-92b9-d357137bd7ac tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:35:20.080206 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-53375120-1bcd-441f-92b9-d357137bd7ac tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:35:20.081519 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-53375120-1bcd-441f-92b9-d357137bd7ac tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] 10.222.0.46 "GET /compute/v2.1/servers/e69d4892-0a83-4d51-8ffd-904f1050907d" status: 200 len: 1739 microversion: 2.20 time: 0.197515 Aug 04 05:35:20.082103 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 476/964] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Aug 4 05:35:19 2022] GET /compute/v2.1/servers/e69d4892-0a83-4d51-8ffd-904f1050907d => generated 1739 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 05:35:21.107321 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-2200f14f-7fb7-4f02-a13f-5197a6f9d698 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:35:21.107942 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-2200f14f-7fb7-4f02-a13f-5197a6f9d698 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] [instance: e69d4892-0a83-4d51-8ffd-904f1050907d] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:35:21.114334 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-2200f14f-7fb7-4f02-a13f-5197a6f9d698 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:35:21.114622 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-2200f14f-7fb7-4f02-a13f-5197a6f9d698 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:35:21.115368 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-2200f14f-7fb7-4f02-a13f-5197a6f9d698 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:35:21.115806 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-2200f14f-7fb7-4f02-a13f-5197a6f9d698 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:35:21.292794 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-2200f14f-7fb7-4f02-a13f-5197a6f9d698 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:35:21.301886 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-2200f14f-7fb7-4f02-a13f-5197a6f9d698 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:35:21.303853 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-2200f14f-7fb7-4f02-a13f-5197a6f9d698 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:35:21.305613 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-2200f14f-7fb7-4f02-a13f-5197a6f9d698 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] 10.222.0.46 "GET /compute/v2.1/servers/e69d4892-0a83-4d51-8ffd-904f1050907d" status: 200 len: 1739 microversion: 2.20 time: 0.202991 Aug 04 05:35:21.306530 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 489/965] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Aug 4 05:35:21 2022] GET /compute/v2.1/servers/e69d4892-0a83-4d51-8ffd-904f1050907d => generated 1739 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 05:35:22.331639 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-9d85f906-b719-49f6-8aed-9c4a4c8929c1 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:35:22.332306 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-9d85f906-b719-49f6-8aed-9c4a4c8929c1 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] [instance: e69d4892-0a83-4d51-8ffd-904f1050907d] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:35:22.340965 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-9d85f906-b719-49f6-8aed-9c4a4c8929c1 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:35:22.341513 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-9d85f906-b719-49f6-8aed-9c4a4c8929c1 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:35:22.342384 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-9d85f906-b719-49f6-8aed-9c4a4c8929c1 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:35:22.345679 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-9d85f906-b719-49f6-8aed-9c4a4c8929c1 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:35:22.502412 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-9d85f906-b719-49f6-8aed-9c4a4c8929c1 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:35:22.514403 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-9d85f906-b719-49f6-8aed-9c4a4c8929c1 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:35:22.516039 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-9d85f906-b719-49f6-8aed-9c4a4c8929c1 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:35:22.517232 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-9d85f906-b719-49f6-8aed-9c4a4c8929c1 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] 10.222.0.46 "GET /compute/v2.1/servers/e69d4892-0a83-4d51-8ffd-904f1050907d" status: 200 len: 1739 microversion: 2.20 time: 0.191064 Aug 04 05:35:22.518173 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 477/966] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Aug 4 05:35:22 2022] GET /compute/v2.1/servers/e69d4892-0a83-4d51-8ffd-904f1050907d => generated 1739 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 05:35:23.542078 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-0f10c451-7e3e-4991-b504-a878f600392c tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:35:23.542795 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-0f10c451-7e3e-4991-b504-a878f600392c tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] [instance: e69d4892-0a83-4d51-8ffd-904f1050907d] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:35:23.550043 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-0f10c451-7e3e-4991-b504-a878f600392c tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:35:23.550515 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-0f10c451-7e3e-4991-b504-a878f600392c tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:35:23.551300 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-0f10c451-7e3e-4991-b504-a878f600392c tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:35:23.551734 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-0f10c451-7e3e-4991-b504-a878f600392c tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:35:23.706161 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-0f10c451-7e3e-4991-b504-a878f600392c tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:35:23.719155 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-0f10c451-7e3e-4991-b504-a878f600392c tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:35:23.721803 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-0f10c451-7e3e-4991-b504-a878f600392c tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:35:23.723367 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-0f10c451-7e3e-4991-b504-a878f600392c tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] 10.222.0.46 "GET /compute/v2.1/servers/e69d4892-0a83-4d51-8ffd-904f1050907d" status: 200 len: 1739 microversion: 2.20 time: 0.185576 Aug 04 05:35:23.724160 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 490/967] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Aug 4 05:35:23 2022] GET /compute/v2.1/servers/e69d4892-0a83-4d51-8ffd-904f1050907d => generated 1739 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 05:35:24.751837 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-07e99f20-7c53-4216-96b7-cb661ea242f7 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:35:24.752481 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-07e99f20-7c53-4216-96b7-cb661ea242f7 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] [instance: e69d4892-0a83-4d51-8ffd-904f1050907d] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:35:24.760209 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-07e99f20-7c53-4216-96b7-cb661ea242f7 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:35:24.760656 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-07e99f20-7c53-4216-96b7-cb661ea242f7 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:35:24.761433 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-07e99f20-7c53-4216-96b7-cb661ea242f7 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:35:24.761869 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-07e99f20-7c53-4216-96b7-cb661ea242f7 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:35:24.896310 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-07e99f20-7c53-4216-96b7-cb661ea242f7 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:35:24.904806 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-07e99f20-7c53-4216-96b7-cb661ea242f7 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:35:24.906433 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-07e99f20-7c53-4216-96b7-cb661ea242f7 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:35:24.907603 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-07e99f20-7c53-4216-96b7-cb661ea242f7 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] 10.222.0.46 "GET /compute/v2.1/servers/e69d4892-0a83-4d51-8ffd-904f1050907d" status: 200 len: 1739 microversion: 2.20 time: 0.159746 Aug 04 05:35:24.908176 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 478/968] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Aug 4 05:35:24 2022] GET /compute/v2.1/servers/e69d4892-0a83-4d51-8ffd-904f1050907d => generated 1739 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 05:35:25.931995 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-88bc4343-e346-433f-bff5-14f51de940a5 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:35:25.932607 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-88bc4343-e346-433f-bff5-14f51de940a5 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] [instance: e69d4892-0a83-4d51-8ffd-904f1050907d] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:35:25.938859 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-88bc4343-e346-433f-bff5-14f51de940a5 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:35:25.939305 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-88bc4343-e346-433f-bff5-14f51de940a5 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:35:25.940075 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-88bc4343-e346-433f-bff5-14f51de940a5 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:35:25.940506 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-88bc4343-e346-433f-bff5-14f51de940a5 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:35:26.384167 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-88bc4343-e346-433f-bff5-14f51de940a5 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:35:26.392273 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-88bc4343-e346-433f-bff5-14f51de940a5 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:35:26.393792 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-88bc4343-e346-433f-bff5-14f51de940a5 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:35:26.394992 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-88bc4343-e346-433f-bff5-14f51de940a5 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] 10.222.0.46 "GET /compute/v2.1/servers/e69d4892-0a83-4d51-8ffd-904f1050907d" status: 200 len: 1721 microversion: 2.20 time: 0.467704 Aug 04 05:35:26.395545 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 491/969] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Aug 4 05:35:25 2022] GET /compute/v2.1/servers/e69d4892-0a83-4d51-8ffd-904f1050907d => generated 1721 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 05:35:27.419237 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-740f965f-f50c-4803-835e-5258bbfce344 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:35:27.419877 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-740f965f-f50c-4803-835e-5258bbfce344 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] [instance: e69d4892-0a83-4d51-8ffd-904f1050907d] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:35:27.426262 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-740f965f-f50c-4803-835e-5258bbfce344 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:35:27.426738 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-740f965f-f50c-4803-835e-5258bbfce344 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:35:27.427488 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-740f965f-f50c-4803-835e-5258bbfce344 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:35:27.427916 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-740f965f-f50c-4803-835e-5258bbfce344 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:35:27.560143 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-740f965f-f50c-4803-835e-5258bbfce344 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:35:27.566236 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-740f965f-f50c-4803-835e-5258bbfce344 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:35:27.567755 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-740f965f-f50c-4803-835e-5258bbfce344 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:35:27.569020 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-740f965f-f50c-4803-835e-5258bbfce344 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] 10.222.0.46 "GET /compute/v2.1/servers/e69d4892-0a83-4d51-8ffd-904f1050907d" status: 200 len: 1721 microversion: 2.20 time: 0.154357 Aug 04 05:35:27.569580 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 479/970] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Aug 4 05:35:27 2022] GET /compute/v2.1/servers/e69d4892-0a83-4d51-8ffd-904f1050907d => generated 1721 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 05:35:28.595252 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-d0651bf5-539c-43d8-806e-c3a29499c113 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:35:28.595801 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-d0651bf5-539c-43d8-806e-c3a29499c113 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] [instance: e69d4892-0a83-4d51-8ffd-904f1050907d] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:35:28.605551 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-d0651bf5-539c-43d8-806e-c3a29499c113 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:35:28.605992 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-d0651bf5-539c-43d8-806e-c3a29499c113 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:35:28.606790 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-d0651bf5-539c-43d8-806e-c3a29499c113 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:35:28.607220 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-d0651bf5-539c-43d8-806e-c3a29499c113 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:35:28.748279 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-d0651bf5-539c-43d8-806e-c3a29499c113 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:35:28.756520 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-d0651bf5-539c-43d8-806e-c3a29499c113 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:35:28.758017 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-d0651bf5-539c-43d8-806e-c3a29499c113 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:35:28.759231 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-d0651bf5-539c-43d8-806e-c3a29499c113 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] 10.222.0.46 "GET /compute/v2.1/servers/e69d4892-0a83-4d51-8ffd-904f1050907d" status: 200 len: 1724 microversion: 2.20 time: 0.170197 Aug 04 05:35:28.759871 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 492/971] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Aug 4 05:35:28 2022] GET /compute/v2.1/servers/e69d4892-0a83-4d51-8ffd-904f1050907d => generated 1724 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 05:35:28.783417 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-07ccc80e-78bb-4b65-891d-daabd12b533b tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3e11269b-59ee-46e5-a372-9bbf235a4e59"}} {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:35:28.785812 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-07ccc80e-78bb-4b65-891d-daabd12b533b tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] [instance: e69d4892-0a83-4d51-8ffd-904f1050907d] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:35:28.793698 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-07ccc80e-78bb-4b65-891d-daabd12b533b tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:35:28.794142 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-07ccc80e-78bb-4b65-891d-daabd12b533b tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:35:28.794970 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-07ccc80e-78bb-4b65-891d-daabd12b533b tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:35:28.795403 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-07ccc80e-78bb-4b65-891d-daabd12b533b tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:35:29.318005 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [req-b26f4137-1464-4051-9708-c470b8b18a06 req-38749dac-6e99-41f9-9797-61a4de340574 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e69d4892-0a83-4d51-8ffd-904f1050907d", "name": "network-vif-unplugged", "status": "completed", "tag": "846d125f-c82c-42db-8ed7-fe055882b03c"}]} {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:35:29.328247 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [req-b26f4137-1464-4051-9708-c470b8b18a06 req-38749dac-6e99-41f9-9797-61a4de340574 service nova] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:35:29.328700 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [req-b26f4137-1464-4051-9708-c470b8b18a06 req-38749dac-6e99-41f9-9797-61a4de340574 service nova] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:35:29.340795 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.compute.server_external_events [req-b26f4137-1464-4051-9708-c470b8b18a06 req-38749dac-6e99-41f9-9797-61a4de340574 service nova] Unable to find a host for instance e69d4892-0a83-4d51-8ffd-904f1050907d. Dropping event network-vif-unplugged {{(pid=118477) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 04 05:35:29.342601 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [req-b26f4137-1464-4051-9708-c470b8b18a06 req-38749dac-6e99-41f9-9797-61a4de340574 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.027488 Aug 04 05:35:29.342601 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 493/972] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Aug 4 05:35:29 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 29 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 04 05:35:29.799044 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-07ccc80e-78bb-4b65-891d-daabd12b533b tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] 10.222.0.46 "POST /compute/v2.1/servers/e69d4892-0a83-4d51-8ffd-904f1050907d/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.019550 Aug 04 05:35:29.799844 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 480/973] 10.222.0.46 () {62 vars in 1364 bytes} [Thu Aug 4 05:35:28 2022] POST /compute/v2.1/servers/e69d4892-0a83-4d51-8ffd-904f1050907d/os-volume_attachments => generated 188 bytes in 1021 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 05:35:29.926817 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-4b53f153-5043-495d-9841-09d0340618df tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:35:29.927332 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-4b53f153-5043-495d-9841-09d0340618df tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] [instance: e69d4892-0a83-4d51-8ffd-904f1050907d] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:35:29.934517 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-4b53f153-5043-495d-9841-09d0340618df tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:35:29.934961 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-4b53f153-5043-495d-9841-09d0340618df tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:35:29.935713 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-4b53f153-5043-495d-9841-09d0340618df tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:35:29.936144 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-4b53f153-5043-495d-9841-09d0340618df tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:35:30.387420 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-4b53f153-5043-495d-9841-09d0340618df tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] 10.222.0.46 "DELETE /compute/v2.1/servers/e69d4892-0a83-4d51-8ffd-904f1050907d/os-volume_attachments/3e11269b-59ee-46e5-a372-9bbf235a4e59" status: 202 len: 0 microversion: 2.20 time: 0.464544 Aug 04 05:35:30.388005 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 494/974] 10.222.0.46 () {60 vars in 1457 bytes} [Thu Aug 4 05:35:29 2022] DELETE /compute/v2.1/servers/e69d4892-0a83-4d51-8ffd-904f1050907d/os-volume_attachments/3e11269b-59ee-46e5-a372-9bbf235a4e59 => generated 0 bytes in 466 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 04 05:35:30.448340 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-75b93dc0-c47c-4d67-b539-85e17706d399 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:35:30.448936 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-75b93dc0-c47c-4d67-b539-85e17706d399 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] [instance: e69d4892-0a83-4d51-8ffd-904f1050907d] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:35:30.457743 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-75b93dc0-c47c-4d67-b539-85e17706d399 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:35:30.458173 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-75b93dc0-c47c-4d67-b539-85e17706d399 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:35:30.458961 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-75b93dc0-c47c-4d67-b539-85e17706d399 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:35:30.459392 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-75b93dc0-c47c-4d67-b539-85e17706d399 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:35:30.488138 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-75b93dc0-c47c-4d67-b539-85e17706d399 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] [instance: e69d4892-0a83-4d51-8ffd-904f1050907d] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=118476) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Aug 04 05:35:30.709760 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-75b93dc0-c47c-4d67-b539-85e17706d399 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] 10.222.0.46 "POST /compute/v2.1/servers/e69d4892-0a83-4d51-8ffd-904f1050907d/action" status: 202 len: 0 microversion: 2.20 time: 0.266512 Aug 04 05:35:30.710416 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 481/975] 10.222.0.46 () {62 vars in 1319 bytes} [Thu Aug 4 05:35:30 2022] POST /compute/v2.1/servers/e69d4892-0a83-4d51-8ffd-904f1050907d/action => generated 0 bytes in 268 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 04 05:35:30.721364 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-147df662-e254-4b1a-8988-ec42b0aadc54 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:35:30.721364 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-147df662-e254-4b1a-8988-ec42b0aadc54 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] [instance: e69d4892-0a83-4d51-8ffd-904f1050907d] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:35:30.726023 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-147df662-e254-4b1a-8988-ec42b0aadc54 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:35:30.726503 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-147df662-e254-4b1a-8988-ec42b0aadc54 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:35:30.727794 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-147df662-e254-4b1a-8988-ec42b0aadc54 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:35:30.728228 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-147df662-e254-4b1a-8988-ec42b0aadc54 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:35:30.861766 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-147df662-e254-4b1a-8988-ec42b0aadc54 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:35:30.870792 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-147df662-e254-4b1a-8988-ec42b0aadc54 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:35:30.872168 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-147df662-e254-4b1a-8988-ec42b0aadc54 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:35:30.873698 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-147df662-e254-4b1a-8988-ec42b0aadc54 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] 10.222.0.46 "GET /compute/v2.1/servers/e69d4892-0a83-4d51-8ffd-904f1050907d" status: 200 len: 1672 microversion: 2.20 time: 0.158686 Aug 04 05:35:30.873889 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 495/976] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Aug 4 05:35:30 2022] GET /compute/v2.1/servers/e69d4892-0a83-4d51-8ffd-904f1050907d => generated 1672 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 05:35:31.897218 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-e2ad27db-3250-4ef3-8c16-e09908246bcb tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:35:31.897820 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-e2ad27db-3250-4ef3-8c16-e09908246bcb tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] [instance: e69d4892-0a83-4d51-8ffd-904f1050907d] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:35:31.904780 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-e2ad27db-3250-4ef3-8c16-e09908246bcb tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:35:31.905229 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-e2ad27db-3250-4ef3-8c16-e09908246bcb tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:35:31.906047 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-e2ad27db-3250-4ef3-8c16-e09908246bcb tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:35:31.906506 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-e2ad27db-3250-4ef3-8c16-e09908246bcb tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:35:32.041033 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-e2ad27db-3250-4ef3-8c16-e09908246bcb tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:35:32.049000 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-e2ad27db-3250-4ef3-8c16-e09908246bcb tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:35:32.050534 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-e2ad27db-3250-4ef3-8c16-e09908246bcb tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:35:32.051744 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-e2ad27db-3250-4ef3-8c16-e09908246bcb tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] 10.222.0.46 "GET /compute/v2.1/servers/e69d4892-0a83-4d51-8ffd-904f1050907d" status: 200 len: 1674 microversion: 2.20 time: 0.159000 Aug 04 05:35:32.052339 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 482/977] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Aug 4 05:35:31 2022] GET /compute/v2.1/servers/e69d4892-0a83-4d51-8ffd-904f1050907d => generated 1674 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 05:35:33.078055 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-dafe6ece-e7aa-4018-9abd-1c8841c32500 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:35:33.078690 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-dafe6ece-e7aa-4018-9abd-1c8841c32500 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] [instance: e69d4892-0a83-4d51-8ffd-904f1050907d] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:35:33.085399 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-dafe6ece-e7aa-4018-9abd-1c8841c32500 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:35:33.085839 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-dafe6ece-e7aa-4018-9abd-1c8841c32500 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:35:33.086706 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-dafe6ece-e7aa-4018-9abd-1c8841c32500 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:35:33.087140 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-dafe6ece-e7aa-4018-9abd-1c8841c32500 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:35:33.223477 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-dafe6ece-e7aa-4018-9abd-1c8841c32500 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:35:33.233270 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-dafe6ece-e7aa-4018-9abd-1c8841c32500 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:35:33.237190 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-dafe6ece-e7aa-4018-9abd-1c8841c32500 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:35:33.237190 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-dafe6ece-e7aa-4018-9abd-1c8841c32500 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] 10.222.0.46 "GET /compute/v2.1/servers/e69d4892-0a83-4d51-8ffd-904f1050907d" status: 200 len: 1730 microversion: 2.20 time: 0.163074 Aug 04 05:35:33.237190 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 496/978] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Aug 4 05:35:33 2022] GET /compute/v2.1/servers/e69d4892-0a83-4d51-8ffd-904f1050907d => generated 1730 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 05:35:34.259690 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-2732d988-2459-42a8-93cb-30b072e7cfe5 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:35:34.260298 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-2732d988-2459-42a8-93cb-30b072e7cfe5 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] [instance: e69d4892-0a83-4d51-8ffd-904f1050907d] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:35:34.267293 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-2732d988-2459-42a8-93cb-30b072e7cfe5 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:35:34.267755 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-2732d988-2459-42a8-93cb-30b072e7cfe5 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:35:34.268570 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-2732d988-2459-42a8-93cb-30b072e7cfe5 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:35:34.269078 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-2732d988-2459-42a8-93cb-30b072e7cfe5 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:35:34.419224 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-2732d988-2459-42a8-93cb-30b072e7cfe5 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:35:34.427081 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-2732d988-2459-42a8-93cb-30b072e7cfe5 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:35:34.428590 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-2732d988-2459-42a8-93cb-30b072e7cfe5 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:35:34.429739 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-2732d988-2459-42a8-93cb-30b072e7cfe5 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] 10.222.0.46 "GET /compute/v2.1/servers/e69d4892-0a83-4d51-8ffd-904f1050907d" status: 200 len: 1730 microversion: 2.20 time: 0.174567 Aug 04 05:35:34.430507 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 483/979] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Aug 4 05:35:34 2022] GET /compute/v2.1/servers/e69d4892-0a83-4d51-8ffd-904f1050907d => generated 1730 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 05:35:35.453366 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-8aa6d9bf-81d9-43e0-9f7c-38f6ff448718 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:35:35.454906 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-8aa6d9bf-81d9-43e0-9f7c-38f6ff448718 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] [instance: e69d4892-0a83-4d51-8ffd-904f1050907d] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:35:35.463208 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-8aa6d9bf-81d9-43e0-9f7c-38f6ff448718 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:35:35.464017 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-8aa6d9bf-81d9-43e0-9f7c-38f6ff448718 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:35:35.465182 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-8aa6d9bf-81d9-43e0-9f7c-38f6ff448718 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:35:35.465976 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-8aa6d9bf-81d9-43e0-9f7c-38f6ff448718 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:35:35.604960 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-8aa6d9bf-81d9-43e0-9f7c-38f6ff448718 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:35:35.613310 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-8aa6d9bf-81d9-43e0-9f7c-38f6ff448718 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:35:35.615016 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-8aa6d9bf-81d9-43e0-9f7c-38f6ff448718 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:35:35.616239 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-8aa6d9bf-81d9-43e0-9f7c-38f6ff448718 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] 10.222.0.46 "GET /compute/v2.1/servers/e69d4892-0a83-4d51-8ffd-904f1050907d" status: 200 len: 1730 microversion: 2.20 time: 0.167299 Aug 04 05:35:35.617005 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 497/980] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Aug 4 05:35:35 2022] GET /compute/v2.1/servers/e69d4892-0a83-4d51-8ffd-904f1050907d => generated 1730 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 05:35:36.649932 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-d63fffb5-df32-4d7f-957b-e286dd2f828c tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:35:36.650874 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-d63fffb5-df32-4d7f-957b-e286dd2f828c tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] [instance: e69d4892-0a83-4d51-8ffd-904f1050907d] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:35:36.657588 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-d63fffb5-df32-4d7f-957b-e286dd2f828c tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:35:36.658041 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-d63fffb5-df32-4d7f-957b-e286dd2f828c tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:35:36.658864 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-d63fffb5-df32-4d7f-957b-e286dd2f828c tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:35:36.659304 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-d63fffb5-df32-4d7f-957b-e286dd2f828c tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:35:36.800750 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-d63fffb5-df32-4d7f-957b-e286dd2f828c tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:35:36.810554 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-d63fffb5-df32-4d7f-957b-e286dd2f828c tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:35:36.815294 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-d63fffb5-df32-4d7f-957b-e286dd2f828c tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:35:36.816620 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-d63fffb5-df32-4d7f-957b-e286dd2f828c tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] 10.222.0.46 "GET /compute/v2.1/servers/e69d4892-0a83-4d51-8ffd-904f1050907d" status: 200 len: 1730 microversion: 2.20 time: 0.171922 Aug 04 05:35:36.817199 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 484/981] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Aug 4 05:35:36 2022] GET /compute/v2.1/servers/e69d4892-0a83-4d51-8ffd-904f1050907d => generated 1730 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 05:35:37.842546 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-05ee0638-4109-4e1a-bb1c-939b5ce2891b tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:35:37.847106 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-05ee0638-4109-4e1a-bb1c-939b5ce2891b tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] [instance: e69d4892-0a83-4d51-8ffd-904f1050907d] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:35:37.852514 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-05ee0638-4109-4e1a-bb1c-939b5ce2891b tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:35:37.853216 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-05ee0638-4109-4e1a-bb1c-939b5ce2891b tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:35:37.854602 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-05ee0638-4109-4e1a-bb1c-939b5ce2891b tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:35:37.855331 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-05ee0638-4109-4e1a-bb1c-939b5ce2891b tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:35:38.061394 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-05ee0638-4109-4e1a-bb1c-939b5ce2891b tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:35:38.070088 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-05ee0638-4109-4e1a-bb1c-939b5ce2891b tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:35:38.072900 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-05ee0638-4109-4e1a-bb1c-939b5ce2891b tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:35:38.074533 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-05ee0638-4109-4e1a-bb1c-939b5ce2891b tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] 10.222.0.46 "GET /compute/v2.1/servers/e69d4892-0a83-4d51-8ffd-904f1050907d" status: 200 len: 1730 microversion: 2.20 time: 0.237114 Aug 04 05:35:38.075040 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 498/982] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Aug 4 05:35:37 2022] GET /compute/v2.1/servers/e69d4892-0a83-4d51-8ffd-904f1050907d => generated 1730 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 05:35:39.099686 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-364c84ae-32d3-432b-9d81-2688c085cce1 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:35:39.102182 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-364c84ae-32d3-432b-9d81-2688c085cce1 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] [instance: e69d4892-0a83-4d51-8ffd-904f1050907d] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:35:39.109448 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-364c84ae-32d3-432b-9d81-2688c085cce1 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:35:39.109676 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-364c84ae-32d3-432b-9d81-2688c085cce1 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:35:39.110283 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-364c84ae-32d3-432b-9d81-2688c085cce1 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:35:39.110724 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-364c84ae-32d3-432b-9d81-2688c085cce1 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:35:39.290495 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-364c84ae-32d3-432b-9d81-2688c085cce1 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:35:39.307096 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-364c84ae-32d3-432b-9d81-2688c085cce1 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:35:39.309825 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-364c84ae-32d3-432b-9d81-2688c085cce1 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:35:39.311167 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-364c84ae-32d3-432b-9d81-2688c085cce1 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] 10.222.0.46 "GET /compute/v2.1/servers/e69d4892-0a83-4d51-8ffd-904f1050907d" status: 200 len: 1730 microversion: 2.20 time: 0.215674 Aug 04 05:35:39.322071 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 485/983] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Aug 4 05:35:39 2022] GET /compute/v2.1/servers/e69d4892-0a83-4d51-8ffd-904f1050907d => generated 1730 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 05:35:40.342807 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-dd4a865f-bde8-42e5-9475-6ce4c0fab5f0 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:35:40.343449 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-dd4a865f-bde8-42e5-9475-6ce4c0fab5f0 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] [instance: e69d4892-0a83-4d51-8ffd-904f1050907d] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:35:40.350577 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-dd4a865f-bde8-42e5-9475-6ce4c0fab5f0 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:35:40.351022 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-dd4a865f-bde8-42e5-9475-6ce4c0fab5f0 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:35:40.352007 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-dd4a865f-bde8-42e5-9475-6ce4c0fab5f0 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:35:40.352446 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-dd4a865f-bde8-42e5-9475-6ce4c0fab5f0 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:35:40.512755 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-dd4a865f-bde8-42e5-9475-6ce4c0fab5f0 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:35:40.521305 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-dd4a865f-bde8-42e5-9475-6ce4c0fab5f0 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:35:40.522864 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-dd4a865f-bde8-42e5-9475-6ce4c0fab5f0 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:35:40.524763 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-dd4a865f-bde8-42e5-9475-6ce4c0fab5f0 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] 10.222.0.46 "GET /compute/v2.1/servers/e69d4892-0a83-4d51-8ffd-904f1050907d" status: 200 len: 1730 microversion: 2.20 time: 0.185519 Aug 04 05:35:40.525832 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 499/984] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Aug 4 05:35:40 2022] GET /compute/v2.1/servers/e69d4892-0a83-4d51-8ffd-904f1050907d => generated 1730 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 05:35:41.551796 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-ec0eb42d-444c-4507-b223-18591f0c65c2 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:35:41.552400 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-ec0eb42d-444c-4507-b223-18591f0c65c2 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] [instance: e69d4892-0a83-4d51-8ffd-904f1050907d] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:35:41.559907 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-ec0eb42d-444c-4507-b223-18591f0c65c2 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:35:41.560346 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-ec0eb42d-444c-4507-b223-18591f0c65c2 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:35:41.561105 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-ec0eb42d-444c-4507-b223-18591f0c65c2 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:35:41.561540 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-ec0eb42d-444c-4507-b223-18591f0c65c2 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:35:41.694672 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-ec0eb42d-444c-4507-b223-18591f0c65c2 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:35:41.697771 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG dbcounter [-] [118476] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=118476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:35:41.704300 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-ec0eb42d-444c-4507-b223-18591f0c65c2 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:35:41.705842 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-ec0eb42d-444c-4507-b223-18591f0c65c2 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:35:41.707031 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-ec0eb42d-444c-4507-b223-18591f0c65c2 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] 10.222.0.46 "GET /compute/v2.1/servers/e69d4892-0a83-4d51-8ffd-904f1050907d" status: 200 len: 1730 microversion: 2.20 time: 0.159321 Aug 04 05:35:41.707600 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 486/985] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Aug 4 05:35:41 2022] GET /compute/v2.1/servers/e69d4892-0a83-4d51-8ffd-904f1050907d => generated 1730 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 05:35:42.731698 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-82f63ab7-245a-4d23-8ade-ea8610ca1b90 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:35:42.732280 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-82f63ab7-245a-4d23-8ade-ea8610ca1b90 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] [instance: e69d4892-0a83-4d51-8ffd-904f1050907d] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:35:42.738980 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-82f63ab7-245a-4d23-8ade-ea8610ca1b90 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:35:42.740398 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-82f63ab7-245a-4d23-8ade-ea8610ca1b90 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:35:42.740398 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-82f63ab7-245a-4d23-8ade-ea8610ca1b90 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:35:42.740673 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-82f63ab7-245a-4d23-8ade-ea8610ca1b90 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:35:42.873134 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-82f63ab7-245a-4d23-8ade-ea8610ca1b90 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:35:42.876543 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG dbcounter [-] [118477] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=118477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:35:42.881322 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-82f63ab7-245a-4d23-8ade-ea8610ca1b90 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:35:42.882845 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-82f63ab7-245a-4d23-8ade-ea8610ca1b90 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:35:42.884665 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-82f63ab7-245a-4d23-8ade-ea8610ca1b90 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] 10.222.0.46 "GET /compute/v2.1/servers/e69d4892-0a83-4d51-8ffd-904f1050907d" status: 200 len: 1730 microversion: 2.20 time: 0.156530 Aug 04 05:35:42.885219 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 500/986] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Aug 4 05:35:42 2022] GET /compute/v2.1/servers/e69d4892-0a83-4d51-8ffd-904f1050907d => generated 1730 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 05:35:43.908702 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-7317a392-d66e-4ca0-88cf-8e6f9a456b6a tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:35:43.909337 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-7317a392-d66e-4ca0-88cf-8e6f9a456b6a tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] [instance: e69d4892-0a83-4d51-8ffd-904f1050907d] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:35:43.911605 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG dbcounter [-] [118476] Writing DB stats nova_api:SELECT=32,nova_api:UPDATE=1 {{(pid=118476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:35:43.916901 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-7317a392-d66e-4ca0-88cf-8e6f9a456b6a tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:35:43.917349 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-7317a392-d66e-4ca0-88cf-8e6f9a456b6a tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:35:43.918126 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-7317a392-d66e-4ca0-88cf-8e6f9a456b6a tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:35:43.918692 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-7317a392-d66e-4ca0-88cf-8e6f9a456b6a tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:35:44.053030 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-7317a392-d66e-4ca0-88cf-8e6f9a456b6a tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:35:44.061560 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-7317a392-d66e-4ca0-88cf-8e6f9a456b6a tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:35:44.063087 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-7317a392-d66e-4ca0-88cf-8e6f9a456b6a tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:35:44.064232 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-7317a392-d66e-4ca0-88cf-8e6f9a456b6a tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] 10.222.0.46 "GET /compute/v2.1/servers/e69d4892-0a83-4d51-8ffd-904f1050907d" status: 200 len: 1730 microversion: 2.20 time: 0.159826 Aug 04 05:35:44.064786 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 487/987] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Aug 4 05:35:43 2022] GET /compute/v2.1/servers/e69d4892-0a83-4d51-8ffd-904f1050907d => generated 1730 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 05:35:45.087147 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-85098daa-f230-4a80-812d-cc8903318ae2 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:35:45.088981 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-85098daa-f230-4a80-812d-cc8903318ae2 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] [instance: e69d4892-0a83-4d51-8ffd-904f1050907d] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:35:45.096303 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-85098daa-f230-4a80-812d-cc8903318ae2 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:35:45.096752 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-85098daa-f230-4a80-812d-cc8903318ae2 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:35:45.097517 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-85098daa-f230-4a80-812d-cc8903318ae2 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:35:45.097952 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-85098daa-f230-4a80-812d-cc8903318ae2 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:35:45.231932 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-85098daa-f230-4a80-812d-cc8903318ae2 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:35:45.238967 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-85098daa-f230-4a80-812d-cc8903318ae2 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:35:45.240466 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-85098daa-f230-4a80-812d-cc8903318ae2 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:35:45.241604 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-85098daa-f230-4a80-812d-cc8903318ae2 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] 10.222.0.46 "GET /compute/v2.1/servers/e69d4892-0a83-4d51-8ffd-904f1050907d" status: 200 len: 1730 microversion: 2.20 time: 0.158450 Aug 04 05:35:45.242151 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 501/988] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Aug 4 05:35:45 2022] GET /compute/v2.1/servers/e69d4892-0a83-4d51-8ffd-904f1050907d => generated 1730 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 05:35:45.421997 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [req-7ebe369a-e30a-49a0-a3ef-115395433aed req-9e28eb8b-453a-4ccd-b55e-cadbcbb50fe6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e69d4892-0a83-4d51-8ffd-904f1050907d", "name": "network-vif-plugged", "status": "completed", "tag": "846d125f-c82c-42db-8ed7-fe055882b03c"}]} {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:35:45.432304 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [req-7ebe369a-e30a-49a0-a3ef-115395433aed req-9e28eb8b-453a-4ccd-b55e-cadbcbb50fe6 service nova] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:35:45.432747 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [req-7ebe369a-e30a-49a0-a3ef-115395433aed req-9e28eb8b-453a-4ccd-b55e-cadbcbb50fe6 service nova] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:35:45.443488 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.compute.server_external_events [req-7ebe369a-e30a-49a0-a3ef-115395433aed req-9e28eb8b-453a-4ccd-b55e-cadbcbb50fe6 service nova] Creating event network-vif-plugged:846d125f-c82c-42db-8ed7-fe055882b03c for instance e69d4892-0a83-4d51-8ffd-904f1050907d on hv-cinder-85207 Aug 04 05:35:45.449213 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [req-7ebe369a-e30a-49a0-a3ef-115395433aed req-9e28eb8b-453a-4ccd-b55e-cadbcbb50fe6 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031612 Aug 04 05:35:45.449797 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 488/989] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Aug 4 05:35:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:35:46.265652 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-5bf73e92-5b18-4860-9483-7d0de9e01fd5 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:35:46.266265 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-5bf73e92-5b18-4860-9483-7d0de9e01fd5 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] [instance: e69d4892-0a83-4d51-8ffd-904f1050907d] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:35:46.272795 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-5bf73e92-5b18-4860-9483-7d0de9e01fd5 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:35:46.273227 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-5bf73e92-5b18-4860-9483-7d0de9e01fd5 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:35:46.273972 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-5bf73e92-5b18-4860-9483-7d0de9e01fd5 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:35:46.275057 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-5bf73e92-5b18-4860-9483-7d0de9e01fd5 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:35:46.405566 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-5bf73e92-5b18-4860-9483-7d0de9e01fd5 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:35:46.413475 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-5bf73e92-5b18-4860-9483-7d0de9e01fd5 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:35:46.415204 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-5bf73e92-5b18-4860-9483-7d0de9e01fd5 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:35:46.416380 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-5bf73e92-5b18-4860-9483-7d0de9e01fd5 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] 10.222.0.46 "GET /compute/v2.1/servers/e69d4892-0a83-4d51-8ffd-904f1050907d" status: 200 len: 1730 microversion: 2.20 time: 0.154579 Aug 04 05:35:46.416939 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 502/990] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Aug 4 05:35:46 2022] GET /compute/v2.1/servers/e69d4892-0a83-4d51-8ffd-904f1050907d => generated 1730 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 05:35:47.440121 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-ad529f89-f9cb-4869-a858-7ae7bc246748 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:35:47.440851 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-ad529f89-f9cb-4869-a858-7ae7bc246748 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] [instance: e69d4892-0a83-4d51-8ffd-904f1050907d] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:35:47.447580 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-ad529f89-f9cb-4869-a858-7ae7bc246748 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:35:47.448028 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-ad529f89-f9cb-4869-a858-7ae7bc246748 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:35:47.448842 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-ad529f89-f9cb-4869-a858-7ae7bc246748 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:35:47.449275 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-ad529f89-f9cb-4869-a858-7ae7bc246748 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:35:47.584852 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-ad529f89-f9cb-4869-a858-7ae7bc246748 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:35:47.593470 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-ad529f89-f9cb-4869-a858-7ae7bc246748 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:35:47.594999 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-ad529f89-f9cb-4869-a858-7ae7bc246748 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:35:47.596160 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-ad529f89-f9cb-4869-a858-7ae7bc246748 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] 10.222.0.46 "GET /compute/v2.1/servers/e69d4892-0a83-4d51-8ffd-904f1050907d" status: 200 len: 1730 microversion: 2.20 time: 0.160693 Aug 04 05:35:47.596717 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 489/991] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Aug 4 05:35:47 2022] GET /compute/v2.1/servers/e69d4892-0a83-4d51-8ffd-904f1050907d => generated 1730 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 05:35:48.621122 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-bb2dd719-b02d-4530-9766-c59667df441a tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:35:48.621702 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-bb2dd719-b02d-4530-9766-c59667df441a tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] [instance: e69d4892-0a83-4d51-8ffd-904f1050907d] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:35:48.624123 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG dbcounter [-] [118477] Writing DB stats nova_api:SELECT=32 {{(pid=118477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:35:48.629007 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-bb2dd719-b02d-4530-9766-c59667df441a tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:35:48.629445 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-bb2dd719-b02d-4530-9766-c59667df441a tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:35:48.630192 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-bb2dd719-b02d-4530-9766-c59667df441a tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:35:48.630719 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-bb2dd719-b02d-4530-9766-c59667df441a tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:35:48.765928 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-bb2dd719-b02d-4530-9766-c59667df441a tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:35:48.774079 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-bb2dd719-b02d-4530-9766-c59667df441a tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:35:48.776618 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-bb2dd719-b02d-4530-9766-c59667df441a tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:35:48.777770 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-bb2dd719-b02d-4530-9766-c59667df441a tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] 10.222.0.46 "GET /compute/v2.1/servers/e69d4892-0a83-4d51-8ffd-904f1050907d" status: 200 len: 1717 microversion: 2.20 time: 0.161146 Aug 04 05:35:48.778457 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 503/992] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Aug 4 05:35:48 2022] GET /compute/v2.1/servers/e69d4892-0a83-4d51-8ffd-904f1050907d => generated 1717 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 05:36:19.406802 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-a79481aa-f020-4bb2-a686-901a31e9e8cf tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:36:19.408914 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-a79481aa-f020-4bb2-a686-901a31e9e8cf tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] [instance: e69d4892-0a83-4d51-8ffd-904f1050907d] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:36:19.411788 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG dbcounter [-] [118476] Writing DB stats nova_api:SELECT=5 {{(pid=118476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:36:19.412443 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG dbcounter [-] [118476] Writing DB stats nova_cell1:SELECT=15 {{(pid=118476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:36:19.417158 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-a79481aa-f020-4bb2-a686-901a31e9e8cf tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:36:19.417665 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-a79481aa-f020-4bb2-a686-901a31e9e8cf tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:36:19.418464 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-a79481aa-f020-4bb2-a686-901a31e9e8cf tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:36:19.418903 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-a79481aa-f020-4bb2-a686-901a31e9e8cf tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:36:19.448156 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-a79481aa-f020-4bb2-a686-901a31e9e8cf tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] 10.222.0.46 "GET /compute/v2.1/servers/e69d4892-0a83-4d51-8ffd-904f1050907d/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.045336 Aug 04 05:36:19.448717 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 490/993] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Aug 4 05:36:19 2022] GET /compute/v2.1/servers/e69d4892-0a83-4d51-8ffd-904f1050907d/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:36:19.511913 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-c5ff6c6d-f323-465d-9363-42ff9ecfd870 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:36:19.512448 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-c5ff6c6d-f323-465d-9363-42ff9ecfd870 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] [instance: e69d4892-0a83-4d51-8ffd-904f1050907d] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:36:19.514608 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG dbcounter [-] [118477] Writing DB stats nova_api:SELECT=1 {{(pid=118477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:36:19.515405 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG dbcounter [-] [118477] Writing DB stats nova_cell1:SELECT=18 {{(pid=118477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:36:19.520699 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-c5ff6c6d-f323-465d-9363-42ff9ecfd870 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:36:19.526869 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-c5ff6c6d-f323-465d-9363-42ff9ecfd870 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:36:19.526869 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-c5ff6c6d-f323-465d-9363-42ff9ecfd870 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:36:19.526869 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-c5ff6c6d-f323-465d-9363-42ff9ecfd870 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:36:19.547880 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-c5ff6c6d-f323-465d-9363-42ff9ecfd870 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] [instance: e69d4892-0a83-4d51-8ffd-904f1050907d] Going to try to terminate instance {{(pid=118477) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 05:36:19.764470 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-c5ff6c6d-f323-465d-9363-42ff9ecfd870 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] 10.222.0.46 "DELETE /compute/v2.1/servers/e69d4892-0a83-4d51-8ffd-904f1050907d" status: 204 len: 0 microversion: 2.20 time: 0.256078 Aug 04 05:36:19.765008 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 504/994] 10.222.0.46 () {60 vars in 1280 bytes} [Thu Aug 4 05:36:19 2022] DELETE /compute/v2.1/servers/e69d4892-0a83-4d51-8ffd-904f1050907d => generated 0 bytes in 258 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 04 05:36:19.774285 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-4c372dee-6837-4437-a309-f9fb9ffe0696 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:36:19.776123 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-4c372dee-6837-4437-a309-f9fb9ffe0696 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] [instance: e69d4892-0a83-4d51-8ffd-904f1050907d] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:36:19.781815 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-4c372dee-6837-4437-a309-f9fb9ffe0696 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:36:19.782263 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-4c372dee-6837-4437-a309-f9fb9ffe0696 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:36:19.783053 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-4c372dee-6837-4437-a309-f9fb9ffe0696 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:36:19.783489 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-4c372dee-6837-4437-a309-f9fb9ffe0696 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:36:19.918676 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-4c372dee-6837-4437-a309-f9fb9ffe0696 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:36:19.927130 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-4c372dee-6837-4437-a309-f9fb9ffe0696 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:36:19.928643 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-4c372dee-6837-4437-a309-f9fb9ffe0696 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:36:19.929789 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-4c372dee-6837-4437-a309-f9fb9ffe0696 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] 10.222.0.46 "GET /compute/v2.1/servers/e69d4892-0a83-4d51-8ffd-904f1050907d" status: 200 len: 1723 microversion: 2.20 time: 0.159741 Aug 04 05:36:19.930363 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 491/995] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Aug 4 05:36:19 2022] GET /compute/v2.1/servers/e69d4892-0a83-4d51-8ffd-904f1050907d => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 05:36:20.953865 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-64f481e4-192b-47a4-bfa0-f3b31ab7e39f tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:36:20.954595 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-64f481e4-192b-47a4-bfa0-f3b31ab7e39f tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] [instance: e69d4892-0a83-4d51-8ffd-904f1050907d] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:36:20.962458 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-64f481e4-192b-47a4-bfa0-f3b31ab7e39f tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:36:20.962930 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-64f481e4-192b-47a4-bfa0-f3b31ab7e39f tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:36:20.963722 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-64f481e4-192b-47a4-bfa0-f3b31ab7e39f tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:36:20.964148 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-64f481e4-192b-47a4-bfa0-f3b31ab7e39f tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:36:21.098769 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-64f481e4-192b-47a4-bfa0-f3b31ab7e39f tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:36:21.106776 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-64f481e4-192b-47a4-bfa0-f3b31ab7e39f tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:36:21.108249 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-64f481e4-192b-47a4-bfa0-f3b31ab7e39f tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:36:21.109387 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-64f481e4-192b-47a4-bfa0-f3b31ab7e39f tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] 10.222.0.46 "GET /compute/v2.1/servers/e69d4892-0a83-4d51-8ffd-904f1050907d" status: 200 len: 1723 microversion: 2.20 time: 0.159942 Aug 04 05:36:21.109932 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 505/996] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Aug 4 05:36:20 2022] GET /compute/v2.1/servers/e69d4892-0a83-4d51-8ffd-904f1050907d => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 05:36:22.135611 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-e39bec76-9f37-4f4f-8ea5-2494f3b59869 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:36:22.136006 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-e39bec76-9f37-4f4f-8ea5-2494f3b59869 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] [instance: e69d4892-0a83-4d51-8ffd-904f1050907d] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:36:22.142271 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-e39bec76-9f37-4f4f-8ea5-2494f3b59869 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:36:22.142758 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-e39bec76-9f37-4f4f-8ea5-2494f3b59869 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:36:22.143842 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-e39bec76-9f37-4f4f-8ea5-2494f3b59869 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:36:22.144292 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-e39bec76-9f37-4f4f-8ea5-2494f3b59869 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:36:22.226339 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-e39bec76-9f37-4f4f-8ea5-2494f3b59869 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:36:22.236246 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-e39bec76-9f37-4f4f-8ea5-2494f3b59869 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:36:22.237729 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-e39bec76-9f37-4f4f-8ea5-2494f3b59869 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd2797b8820c41a2ae939fd7c473a549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290c5e886bf64e989f2be4b94a570e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:36:22.239331 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-e39bec76-9f37-4f4f-8ea5-2494f3b59869 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] 10.222.0.46 "GET /compute/v2.1/servers/e69d4892-0a83-4d51-8ffd-904f1050907d" status: 200 len: 1655 microversion: 2.20 time: 0.110304 Aug 04 05:36:22.253061 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 492/997] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Aug 4 05:36:22 2022] GET /compute/v2.1/servers/e69d4892-0a83-4d51-8ffd-904f1050907d => generated 1655 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 05:36:22.259418 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [req-480a602c-c8eb-4b1c-8969-98eb549cd3c1 req-cfb06051-c392-4c68-8bec-60038b49e533 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e69d4892-0a83-4d51-8ffd-904f1050907d", "name": "network-vif-deleted", "tag": "846d125f-c82c-42db-8ed7-fe055882b03c"}]} {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:36:22.274061 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [req-480a602c-c8eb-4b1c-8969-98eb549cd3c1 req-cfb06051-c392-4c68-8bec-60038b49e533 service nova] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:36:22.274779 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [req-480a602c-c8eb-4b1c-8969-98eb549cd3c1 req-cfb06051-c392-4c68-8bec-60038b49e533 service nova] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:36:22.288344 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.compute.server_external_events [req-480a602c-c8eb-4b1c-8969-98eb549cd3c1 req-cfb06051-c392-4c68-8bec-60038b49e533 service nova] Creating event network-vif-deleted:846d125f-c82c-42db-8ed7-fe055882b03c for instance e69d4892-0a83-4d51-8ffd-904f1050907d on hv-cinder-85207 Aug 04 05:36:22.293893 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [req-480a602c-c8eb-4b1c-8969-98eb549cd3c1 req-cfb06051-c392-4c68-8bec-60038b49e533 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109723 Aug 04 05:36:22.294727 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 506/998] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Aug 4 05:36:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 05:36:23.263135 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-8759acd6-b532-4cc1-8e86-c31eb97fd68a tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:36:23.265687 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-8759acd6-b532-4cc1-8e86-c31eb97fd68a tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] [instance: e69d4892-0a83-4d51-8ffd-904f1050907d] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:36:23.271620 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-8759acd6-b532-4cc1-8e86-c31eb97fd68a tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:36:23.272073 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-8759acd6-b532-4cc1-8e86-c31eb97fd68a tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:36:23.273003 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-8759acd6-b532-4cc1-8e86-c31eb97fd68a tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:36:23.273398 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-8759acd6-b532-4cc1-8e86-c31eb97fd68a tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:36:23.287966 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.wsgi [None req-8759acd6-b532-4cc1-8e86-c31eb97fd68a tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] HTTP exception thrown: Instance e69d4892-0a83-4d51-8ffd-904f1050907d could not be found. Aug 04 05:36:23.289633 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-8759acd6-b532-4cc1-8e86-c31eb97fd68a tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Request method failure captured: Aug 04 05:36:23.289633 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: request: GET /compute/v2.1/servers/e69d4892-0a83-4d51-8ffd-904f1050907d HTTP/1.1 Aug 04 05:36:23.289633 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: Accept: application/json Aug 04 05:36:23.289633 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: Accept-Encoding: identity Aug 04 05:36:23.289633 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: Connection: close Aug 04 05:36:23.289633 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: Content-Length: 0 Aug 04 05:36:23.289633 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: Content-Type: application/json Aug 04 05:36:23.289633 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: Host: 10.222.0.46 Aug 04 05:36:23.289633 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: Openstack-System-Scope: None Aug 04 05:36:23.289633 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: User-Agent: python-urllib3/1.26.11 Aug 04 05:36:23.289633 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Auth-Token: gAAAAABi61mTHXwa9t7PYnVh0SPDIlBJIwH6LJUi-4pbY05vY4D2vuiCk0K_0F9Ze5K3uUqFaa6qtBDZH936B4jmOWpxOLx0Bgos7-B8IgRAneYH0qpvjY1JAMAclXqNfVN0dl8X_WsdkL_aE3tD6DYHka6udZU76mlMPKDTUJQRW8RF5JdDLEY Aug 04 05:36:23.289633 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Domain-Id: None Aug 04 05:36:23.289633 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Domain-Name: None Aug 04 05:36:23.289633 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Identity-Status: Confirmed Aug 04 05:36:23.289633 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Is-Admin-Project: True Aug 04 05:36:23.289633 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Openstack-Nova-Api-Version: 2.20 Aug 04 05:36:23.289633 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Project-Domain-Id: default Aug 04 05:36:23.289633 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Project-Domain-Name: Default Aug 04 05:36:23.289633 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Project-Id: 290c5e886bf64e989f2be4b94a570e3f Aug 04 05:36:23.289633 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1441164991 Aug 04 05:36:23.289633 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Role: member,reader Aug 04 05:36:23.289633 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Roles: member,reader Aug 04 05:36:23.291513 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/290c5e886bf64e989f2be4b94a570e3f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/290c5e886bf64e989f2be4b94a570e3f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_290c5e886bf64e989f2be4b94a570e3f", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/290c5e886bf64e989f2be4b94a570e3f"}]}] Aug 04 05:36:23.291513 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1441164991 Aug 04 05:36:23.291513 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Tenant-Id: 290c5e886bf64e989f2be4b94a570e3f Aug 04 05:36:23.291513 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1441164991 Aug 04 05:36:23.291513 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-User: tempest-AttachVolumeShelveTestJSON-1441164991-project Aug 04 05:36:23.291513 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-User-Domain-Id: default Aug 04 05:36:23.291513 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-User-Domain-Name: Default Aug 04 05:36:23.291513 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-User-Id: fd2797b8820c41a2ae939fd7c473a549 Aug 04 05:36:23.291513 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1441164991-project Aug 04 05:36:23.291513 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: method: > Aug 04 05:36:23.291513 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: exception: Instance e69d4892-0a83-4d51-8ffd-904f1050907d could not be found. Aug 04 05:36:23.291513 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: action_args: {'id': 'e69d4892-0a83-4d51-8ffd-904f1050907d'} Aug 04 05:36:23.292483 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 05:36:23.292483 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:36:23.292483 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 05:36:23.292483 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 05:36:23.292483 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 05:36:23.292483 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 05:36:23.292483 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 05:36:23.292483 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 05:36:23.292483 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 05:36:23.292483 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 05:36:23.292483 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e69d4892-0a83-4d51-8ffd-904f1050907d could not be found. Aug 04 05:36:23.292483 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Aug 04 05:36:23.292483 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:36:23.292483 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Aug 04 05:36:23.292483 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:36:23.292483 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:36:23.292483 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:36:23.292483 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 05:36:23.292483 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 05:36:23.292483 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 05:36:23.293838 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 05:36:23.293838 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 05:36:23.293838 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 05:36:23.293838 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 05:36:23.293838 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 05:36:23.293838 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 05:36:23.293838 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 05:36:23.293838 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e69d4892-0a83-4d51-8ffd-904f1050907d could not be found. Aug 04 05:36:23.293838 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Aug 04 05:36:23.293838 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:36:23.293838 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Aug 04 05:36:23.293838 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:36:23.293838 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:36:23.293838 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:36:23.293838 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 05:36:23.293838 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 05:36:23.293838 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e69d4892-0a83-4d51-8ffd-904f1050907d could not be found. Aug 04 05:36:23.293838 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Aug 04 05:36:23.295760 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-8759acd6-b532-4cc1-8e86-c31eb97fd68a tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Returning 404 to user: Instance e69d4892-0a83-4d51-8ffd-904f1050907d could not be found. {{(pid=118476) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 05:36:23.295760 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-8759acd6-b532-4cc1-8e86-c31eb97fd68a tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] 10.222.0.46 "GET /compute/v2.1/servers/e69d4892-0a83-4d51-8ffd-904f1050907d" status: 404 len: 111 microversion: 2.20 time: 0.031903 Aug 04 05:36:23.295760 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 493/999] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Aug 4 05:36:23 2022] GET /compute/v2.1/servers/e69d4892-0a83-4d51-8ffd-904f1050907d => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 04 05:36:23.300704 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-015d85cd-3ed2-4ed4-a1c9-ce5b9d168c48 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Calling method '.version_select at 0x7f14753ca670>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:36:23.371462 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-015d85cd-3ed2-4ed4-a1c9-ce5b9d168c48 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1770183330" status: 204 len: 0 microversion: 2.20 time: 0.074740 Aug 04 05:36:23.371993 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 507/1000] 10.222.0.46 () {60 vars in 1262 bytes} [Thu Aug 4 05:36:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1770183330 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 04 05:36:25.370546 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-bea056f8-5723-4c16-8dec-9ee3000e8cb1 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:36:25.371049 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-bea056f8-5723-4c16-8dec-9ee3000e8cb1 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] [instance: e69d4892-0a83-4d51-8ffd-904f1050907d] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:36:25.377376 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-bea056f8-5723-4c16-8dec-9ee3000e8cb1 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:36:25.377815 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-bea056f8-5723-4c16-8dec-9ee3000e8cb1 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:36:25.378591 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-bea056f8-5723-4c16-8dec-9ee3000e8cb1 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:36:25.379023 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-bea056f8-5723-4c16-8dec-9ee3000e8cb1 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:36:25.392254 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.wsgi [None req-bea056f8-5723-4c16-8dec-9ee3000e8cb1 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] HTTP exception thrown: Instance e69d4892-0a83-4d51-8ffd-904f1050907d could not be found. Aug 04 05:36:25.393784 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-bea056f8-5723-4c16-8dec-9ee3000e8cb1 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Request method failure captured: Aug 04 05:36:25.393784 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: request: DELETE /compute/v2.1/servers/e69d4892-0a83-4d51-8ffd-904f1050907d HTTP/1.1 Aug 04 05:36:25.393784 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: Accept: application/json Aug 04 05:36:25.393784 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: Accept-Encoding: identity Aug 04 05:36:25.393784 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: Connection: close Aug 04 05:36:25.393784 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: Content-Length: 0 Aug 04 05:36:25.393784 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: Content-Type: application/json Aug 04 05:36:25.393784 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: Host: 10.222.0.46 Aug 04 05:36:25.393784 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: Openstack-System-Scope: None Aug 04 05:36:25.393784 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: User-Agent: python-urllib3/1.26.11 Aug 04 05:36:25.393784 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Auth-Token: gAAAAABi61mTHXwa9t7PYnVh0SPDIlBJIwH6LJUi-4pbY05vY4D2vuiCk0K_0F9Ze5K3uUqFaa6qtBDZH936B4jmOWpxOLx0Bgos7-B8IgRAneYH0qpvjY1JAMAclXqNfVN0dl8X_WsdkL_aE3tD6DYHka6udZU76mlMPKDTUJQRW8RF5JdDLEY Aug 04 05:36:25.393784 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Domain-Id: None Aug 04 05:36:25.393784 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Domain-Name: None Aug 04 05:36:25.393784 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Identity-Status: Confirmed Aug 04 05:36:25.393784 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Is-Admin-Project: True Aug 04 05:36:25.393784 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Openstack-Nova-Api-Version: 2.20 Aug 04 05:36:25.393784 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Project-Domain-Id: default Aug 04 05:36:25.393784 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Project-Domain-Name: Default Aug 04 05:36:25.393784 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Project-Id: 290c5e886bf64e989f2be4b94a570e3f Aug 04 05:36:25.393784 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1441164991 Aug 04 05:36:25.393784 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Role: member,reader Aug 04 05:36:25.393784 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Roles: member,reader Aug 04 05:36:25.395483 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/290c5e886bf64e989f2be4b94a570e3f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/290c5e886bf64e989f2be4b94a570e3f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_290c5e886bf64e989f2be4b94a570e3f", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/290c5e886bf64e989f2be4b94a570e3f"}]}] Aug 04 05:36:25.395483 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1441164991 Aug 04 05:36:25.395483 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Tenant-Id: 290c5e886bf64e989f2be4b94a570e3f Aug 04 05:36:25.395483 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1441164991 Aug 04 05:36:25.395483 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-User: tempest-AttachVolumeShelveTestJSON-1441164991-project Aug 04 05:36:25.395483 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-User-Domain-Id: default Aug 04 05:36:25.395483 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-User-Domain-Name: Default Aug 04 05:36:25.395483 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-User-Id: fd2797b8820c41a2ae939fd7c473a549 Aug 04 05:36:25.395483 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1441164991-project Aug 04 05:36:25.395483 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: method: > Aug 04 05:36:25.395483 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: exception: Instance e69d4892-0a83-4d51-8ffd-904f1050907d could not be found. Aug 04 05:36:25.395483 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: action_args: {'id': 'e69d4892-0a83-4d51-8ffd-904f1050907d'} Aug 04 05:36:25.397175 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 05:36:25.397175 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:36:25.397175 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 05:36:25.397175 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 05:36:25.397175 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 05:36:25.397175 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 05:36:25.397175 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 05:36:25.397175 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 05:36:25.397175 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 05:36:25.397175 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 05:36:25.397175 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e69d4892-0a83-4d51-8ffd-904f1050907d could not be found. Aug 04 05:36:25.397175 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Aug 04 05:36:25.397175 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:36:25.397175 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Aug 04 05:36:25.397175 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:36:25.397175 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:36:25.397175 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:36:25.397175 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 05:36:25.397175 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 05:36:25.397175 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 05:36:25.398880 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 05:36:25.398880 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 05:36:25.398880 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 05:36:25.398880 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 05:36:25.398880 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 05:36:25.398880 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 05:36:25.398880 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 05:36:25.398880 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 05:36:25.398880 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 05:36:25.398880 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e69d4892-0a83-4d51-8ffd-904f1050907d could not be found. Aug 04 05:36:25.398880 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Aug 04 05:36:25.398880 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:36:25.398880 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Aug 04 05:36:25.398880 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:36:25.398880 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:36:25.398880 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:36:25.398880 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 05:36:25.398880 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 05:36:25.398880 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e69d4892-0a83-4d51-8ffd-904f1050907d could not be found. Aug 04 05:36:25.398880 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Aug 04 05:36:25.400374 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-bea056f8-5723-4c16-8dec-9ee3000e8cb1 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Returning 404 to user: Instance e69d4892-0a83-4d51-8ffd-904f1050907d could not be found. {{(pid=118476) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 05:36:25.400374 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-bea056f8-5723-4c16-8dec-9ee3000e8cb1 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] 10.222.0.46 "DELETE /compute/v2.1/servers/e69d4892-0a83-4d51-8ffd-904f1050907d" status: 404 len: 111 microversion: 2.20 time: 0.028622 Aug 04 05:36:25.400374 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 494/1001] 10.222.0.46 () {60 vars in 1280 bytes} [Thu Aug 4 05:36:25 2022] DELETE /compute/v2.1/servers/e69d4892-0a83-4d51-8ffd-904f1050907d => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 04 05:36:25.404944 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-ad4f193c-e013-45d6-96f4-81ac13773576 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:36:25.405664 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-ad4f193c-e013-45d6-96f4-81ac13773576 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] [instance: e69d4892-0a83-4d51-8ffd-904f1050907d] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:36:25.412906 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-ad4f193c-e013-45d6-96f4-81ac13773576 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:36:25.413340 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-ad4f193c-e013-45d6-96f4-81ac13773576 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:36:25.414088 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-ad4f193c-e013-45d6-96f4-81ac13773576 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:36:25.414617 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-ad4f193c-e013-45d6-96f4-81ac13773576 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:36:25.427666 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.wsgi [None req-ad4f193c-e013-45d6-96f4-81ac13773576 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] HTTP exception thrown: Instance e69d4892-0a83-4d51-8ffd-904f1050907d could not be found. Aug 04 05:36:25.429339 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-ad4f193c-e013-45d6-96f4-81ac13773576 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Request method failure captured: Aug 04 05:36:25.429339 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: request: GET /compute/v2.1/servers/e69d4892-0a83-4d51-8ffd-904f1050907d HTTP/1.1 Aug 04 05:36:25.429339 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: Accept: application/json Aug 04 05:36:25.429339 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: Accept-Encoding: identity Aug 04 05:36:25.429339 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: Connection: close Aug 04 05:36:25.429339 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: Content-Length: 0 Aug 04 05:36:25.429339 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: Content-Type: application/json Aug 04 05:36:25.429339 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: Host: 10.222.0.46 Aug 04 05:36:25.429339 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: Openstack-System-Scope: None Aug 04 05:36:25.429339 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: User-Agent: python-urllib3/1.26.11 Aug 04 05:36:25.429339 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Auth-Token: gAAAAABi61mTHXwa9t7PYnVh0SPDIlBJIwH6LJUi-4pbY05vY4D2vuiCk0K_0F9Ze5K3uUqFaa6qtBDZH936B4jmOWpxOLx0Bgos7-B8IgRAneYH0qpvjY1JAMAclXqNfVN0dl8X_WsdkL_aE3tD6DYHka6udZU76mlMPKDTUJQRW8RF5JdDLEY Aug 04 05:36:25.429339 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Domain-Id: None Aug 04 05:36:25.429339 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Domain-Name: None Aug 04 05:36:25.429339 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Identity-Status: Confirmed Aug 04 05:36:25.429339 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Is-Admin-Project: True Aug 04 05:36:25.429339 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Openstack-Nova-Api-Version: 2.20 Aug 04 05:36:25.429339 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Project-Domain-Id: default Aug 04 05:36:25.429339 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Project-Domain-Name: Default Aug 04 05:36:25.429339 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Project-Id: 290c5e886bf64e989f2be4b94a570e3f Aug 04 05:36:25.429339 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1441164991 Aug 04 05:36:25.429339 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Role: member,reader Aug 04 05:36:25.429339 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Roles: member,reader Aug 04 05:36:25.431501 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/290c5e886bf64e989f2be4b94a570e3f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/290c5e886bf64e989f2be4b94a570e3f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_290c5e886bf64e989f2be4b94a570e3f", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/290c5e886bf64e989f2be4b94a570e3f"}]}] Aug 04 05:36:25.431501 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1441164991 Aug 04 05:36:25.431501 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Tenant-Id: 290c5e886bf64e989f2be4b94a570e3f Aug 04 05:36:25.431501 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1441164991 Aug 04 05:36:25.431501 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-User: tempest-AttachVolumeShelveTestJSON-1441164991-project Aug 04 05:36:25.431501 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-User-Domain-Id: default Aug 04 05:36:25.431501 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-User-Domain-Name: Default Aug 04 05:36:25.431501 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-User-Id: fd2797b8820c41a2ae939fd7c473a549 Aug 04 05:36:25.431501 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1441164991-project Aug 04 05:36:25.431501 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: method: > Aug 04 05:36:25.431501 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: exception: Instance e69d4892-0a83-4d51-8ffd-904f1050907d could not be found. Aug 04 05:36:25.431501 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: action_args: {'id': 'e69d4892-0a83-4d51-8ffd-904f1050907d'} Aug 04 05:36:25.432405 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 05:36:25.432405 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:36:25.432405 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 05:36:25.432405 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 05:36:25.432405 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 05:36:25.432405 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 05:36:25.432405 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 05:36:25.432405 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 05:36:25.432405 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 05:36:25.432405 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 05:36:25.432405 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e69d4892-0a83-4d51-8ffd-904f1050907d could not be found. Aug 04 05:36:25.432405 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Aug 04 05:36:25.432405 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:36:25.432405 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Aug 04 05:36:25.432405 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:36:25.432405 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:36:25.432405 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:36:25.432405 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 05:36:25.432405 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 05:36:25.432405 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 05:36:25.433898 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 05:36:25.433898 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 05:36:25.433898 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 05:36:25.433898 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 05:36:25.433898 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 05:36:25.433898 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 05:36:25.433898 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 05:36:25.433898 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e69d4892-0a83-4d51-8ffd-904f1050907d could not be found. Aug 04 05:36:25.433898 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Aug 04 05:36:25.433898 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:36:25.433898 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Aug 04 05:36:25.433898 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:36:25.433898 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:36:25.433898 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:36:25.433898 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 05:36:25.433898 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 05:36:25.433898 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e69d4892-0a83-4d51-8ffd-904f1050907d could not be found. Aug 04 05:36:25.433898 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Aug 04 05:36:25.435270 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-ad4f193c-e013-45d6-96f4-81ac13773576 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Returning 404 to user: Instance e69d4892-0a83-4d51-8ffd-904f1050907d could not be found. {{(pid=118477) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 05:36:25.435270 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-ad4f193c-e013-45d6-96f4-81ac13773576 tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] 10.222.0.46 "GET /compute/v2.1/servers/e69d4892-0a83-4d51-8ffd-904f1050907d" status: 404 len: 111 microversion: 2.20 time: 0.030350 Aug 04 05:36:25.435270 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 508/1002] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Aug 4 05:36:25 2022] GET /compute/v2.1/servers/e69d4892-0a83-4d51-8ffd-904f1050907d => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 04 05:36:26.743145 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-f7f1c3d6-ae1f-41e4-8fbe-038d37ad608e tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:36:26.743656 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-f7f1c3d6-ae1f-41e4-8fbe-038d37ad608e tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] [instance: 2e3bce83-6dff-479d-a54c-8f660fbbcdc5] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:36:26.750151 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-f7f1c3d6-ae1f-41e4-8fbe-038d37ad608e tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:36:26.750646 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-f7f1c3d6-ae1f-41e4-8fbe-038d37ad608e tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:36:26.751416 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-f7f1c3d6-ae1f-41e4-8fbe-038d37ad608e tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:36:26.751888 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-f7f1c3d6-ae1f-41e4-8fbe-038d37ad608e tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:36:26.767958 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.wsgi [None req-f7f1c3d6-ae1f-41e4-8fbe-038d37ad608e tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] HTTP exception thrown: Instance 2e3bce83-6dff-479d-a54c-8f660fbbcdc5 could not be found. Aug 04 05:36:26.769527 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-f7f1c3d6-ae1f-41e4-8fbe-038d37ad608e tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Request method failure captured: Aug 04 05:36:26.769527 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: request: DELETE /compute/v2.1/servers/2e3bce83-6dff-479d-a54c-8f660fbbcdc5 HTTP/1.1 Aug 04 05:36:26.769527 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: Accept: application/json Aug 04 05:36:26.769527 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: Accept-Encoding: identity Aug 04 05:36:26.769527 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: Connection: close Aug 04 05:36:26.769527 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: Content-Length: 0 Aug 04 05:36:26.769527 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: Content-Type: application/json Aug 04 05:36:26.769527 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: Host: 10.222.0.46 Aug 04 05:36:26.769527 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: Openstack-System-Scope: None Aug 04 05:36:26.769527 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: User-Agent: python-urllib3/1.26.11 Aug 04 05:36:26.769527 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Auth-Token: gAAAAABi61mTHXwa9t7PYnVh0SPDIlBJIwH6LJUi-4pbY05vY4D2vuiCk0K_0F9Ze5K3uUqFaa6qtBDZH936B4jmOWpxOLx0Bgos7-B8IgRAneYH0qpvjY1JAMAclXqNfVN0dl8X_WsdkL_aE3tD6DYHka6udZU76mlMPKDTUJQRW8RF5JdDLEY Aug 04 05:36:26.769527 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Domain-Id: None Aug 04 05:36:26.769527 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Domain-Name: None Aug 04 05:36:26.769527 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Identity-Status: Confirmed Aug 04 05:36:26.769527 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Is-Admin-Project: True Aug 04 05:36:26.769527 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Openstack-Nova-Api-Version: 2.20 Aug 04 05:36:26.769527 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Project-Domain-Id: default Aug 04 05:36:26.769527 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Project-Domain-Name: Default Aug 04 05:36:26.769527 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Project-Id: 290c5e886bf64e989f2be4b94a570e3f Aug 04 05:36:26.769527 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1441164991 Aug 04 05:36:26.769527 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Role: member,reader Aug 04 05:36:26.769527 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Roles: member,reader Aug 04 05:36:26.771344 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/290c5e886bf64e989f2be4b94a570e3f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/290c5e886bf64e989f2be4b94a570e3f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_290c5e886bf64e989f2be4b94a570e3f", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/290c5e886bf64e989f2be4b94a570e3f"}]}] Aug 04 05:36:26.771344 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1441164991 Aug 04 05:36:26.771344 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Tenant-Id: 290c5e886bf64e989f2be4b94a570e3f Aug 04 05:36:26.771344 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1441164991 Aug 04 05:36:26.771344 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-User: tempest-AttachVolumeShelveTestJSON-1441164991-project Aug 04 05:36:26.771344 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-User-Domain-Id: default Aug 04 05:36:26.771344 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-User-Domain-Name: Default Aug 04 05:36:26.771344 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-User-Id: fd2797b8820c41a2ae939fd7c473a549 Aug 04 05:36:26.771344 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1441164991-project Aug 04 05:36:26.771344 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: method: > Aug 04 05:36:26.771344 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: exception: Instance 2e3bce83-6dff-479d-a54c-8f660fbbcdc5 could not be found. Aug 04 05:36:26.771344 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: action_args: {'id': '2e3bce83-6dff-479d-a54c-8f660fbbcdc5'} Aug 04 05:36:26.772485 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 05:36:26.772485 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:36:26.772485 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 05:36:26.772485 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 05:36:26.772485 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 05:36:26.772485 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 05:36:26.772485 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 05:36:26.772485 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 05:36:26.772485 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 05:36:26.772485 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 05:36:26.772485 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2e3bce83-6dff-479d-a54c-8f660fbbcdc5 could not be found. Aug 04 05:36:26.772485 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Aug 04 05:36:26.772485 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:36:26.772485 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Aug 04 05:36:26.772485 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:36:26.772485 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:36:26.772485 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:36:26.772485 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 05:36:26.772485 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 05:36:26.772485 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 05:36:26.773892 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 05:36:26.773892 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 05:36:26.773892 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 05:36:26.773892 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 05:36:26.773892 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 05:36:26.773892 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 05:36:26.773892 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 05:36:26.773892 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 05:36:26.773892 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 05:36:26.773892 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2e3bce83-6dff-479d-a54c-8f660fbbcdc5 could not be found. Aug 04 05:36:26.773892 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Aug 04 05:36:26.773892 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:36:26.773892 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Aug 04 05:36:26.773892 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:36:26.773892 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:36:26.773892 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:36:26.773892 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 05:36:26.773892 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 05:36:26.773892 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2e3bce83-6dff-479d-a54c-8f660fbbcdc5 could not be found. Aug 04 05:36:26.773892 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Aug 04 05:36:26.775387 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-f7f1c3d6-ae1f-41e4-8fbe-038d37ad608e tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Returning 404 to user: Instance 2e3bce83-6dff-479d-a54c-8f660fbbcdc5 could not be found. {{(pid=118476) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 05:36:26.775387 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-f7f1c3d6-ae1f-41e4-8fbe-038d37ad608e tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] 10.222.0.46 "DELETE /compute/v2.1/servers/2e3bce83-6dff-479d-a54c-8f660fbbcdc5" status: 404 len: 111 microversion: 2.20 time: 0.032861 Aug 04 05:36:26.775387 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 495/1003] 10.222.0.46 () {60 vars in 1280 bytes} [Thu Aug 4 05:36:26 2022] DELETE /compute/v2.1/servers/2e3bce83-6dff-479d-a54c-8f660fbbcdc5 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 04 05:36:26.779805 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-87f3cd63-5527-4fd4-89f3-31d3b40b0d1d tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:36:26.780415 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-87f3cd63-5527-4fd4-89f3-31d3b40b0d1d tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] [instance: 2e3bce83-6dff-479d-a54c-8f660fbbcdc5] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:36:26.787243 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-87f3cd63-5527-4fd4-89f3-31d3b40b0d1d tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:36:26.787699 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-87f3cd63-5527-4fd4-89f3-31d3b40b0d1d tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:36:26.788519 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-87f3cd63-5527-4fd4-89f3-31d3b40b0d1d tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:36:26.789047 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-87f3cd63-5527-4fd4-89f3-31d3b40b0d1d tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:36:26.802840 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.wsgi [None req-87f3cd63-5527-4fd4-89f3-31d3b40b0d1d tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] HTTP exception thrown: Instance 2e3bce83-6dff-479d-a54c-8f660fbbcdc5 could not be found. Aug 04 05:36:26.804919 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-87f3cd63-5527-4fd4-89f3-31d3b40b0d1d tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Request method failure captured: Aug 04 05:36:26.804919 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: request: GET /compute/v2.1/servers/2e3bce83-6dff-479d-a54c-8f660fbbcdc5 HTTP/1.1 Aug 04 05:36:26.804919 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: Accept: application/json Aug 04 05:36:26.804919 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: Accept-Encoding: identity Aug 04 05:36:26.804919 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: Connection: close Aug 04 05:36:26.804919 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: Content-Length: 0 Aug 04 05:36:26.804919 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: Content-Type: application/json Aug 04 05:36:26.804919 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: Host: 10.222.0.46 Aug 04 05:36:26.804919 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: Openstack-System-Scope: None Aug 04 05:36:26.804919 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: User-Agent: python-urllib3/1.26.11 Aug 04 05:36:26.804919 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Auth-Token: gAAAAABi61mTHXwa9t7PYnVh0SPDIlBJIwH6LJUi-4pbY05vY4D2vuiCk0K_0F9Ze5K3uUqFaa6qtBDZH936B4jmOWpxOLx0Bgos7-B8IgRAneYH0qpvjY1JAMAclXqNfVN0dl8X_WsdkL_aE3tD6DYHka6udZU76mlMPKDTUJQRW8RF5JdDLEY Aug 04 05:36:26.804919 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Domain-Id: None Aug 04 05:36:26.804919 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Domain-Name: None Aug 04 05:36:26.804919 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Identity-Status: Confirmed Aug 04 05:36:26.804919 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Is-Admin-Project: True Aug 04 05:36:26.804919 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Openstack-Nova-Api-Version: 2.20 Aug 04 05:36:26.804919 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Project-Domain-Id: default Aug 04 05:36:26.804919 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Project-Domain-Name: Default Aug 04 05:36:26.804919 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Project-Id: 290c5e886bf64e989f2be4b94a570e3f Aug 04 05:36:26.804919 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1441164991 Aug 04 05:36:26.804919 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Role: member,reader Aug 04 05:36:26.804919 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Roles: member,reader Aug 04 05:36:26.806695 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/290c5e886bf64e989f2be4b94a570e3f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/290c5e886bf64e989f2be4b94a570e3f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_290c5e886bf64e989f2be4b94a570e3f", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/290c5e886bf64e989f2be4b94a570e3f"}]}] Aug 04 05:36:26.806695 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1441164991 Aug 04 05:36:26.806695 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Tenant-Id: 290c5e886bf64e989f2be4b94a570e3f Aug 04 05:36:26.806695 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1441164991 Aug 04 05:36:26.806695 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-User: tempest-AttachVolumeShelveTestJSON-1441164991-project Aug 04 05:36:26.806695 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-User-Domain-Id: default Aug 04 05:36:26.806695 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-User-Domain-Name: Default Aug 04 05:36:26.806695 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-User-Id: fd2797b8820c41a2ae939fd7c473a549 Aug 04 05:36:26.806695 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1441164991-project Aug 04 05:36:26.806695 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: method: > Aug 04 05:36:26.806695 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: exception: Instance 2e3bce83-6dff-479d-a54c-8f660fbbcdc5 could not be found. Aug 04 05:36:26.806695 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: action_args: {'id': '2e3bce83-6dff-479d-a54c-8f660fbbcdc5'} Aug 04 05:36:26.807796 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 05:36:26.807796 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:36:26.807796 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 05:36:26.807796 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 05:36:26.807796 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 05:36:26.807796 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 05:36:26.807796 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 05:36:26.807796 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 05:36:26.807796 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 05:36:26.807796 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 05:36:26.807796 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2e3bce83-6dff-479d-a54c-8f660fbbcdc5 could not be found. Aug 04 05:36:26.807796 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Aug 04 05:36:26.807796 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:36:26.807796 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Aug 04 05:36:26.807796 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:36:26.807796 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:36:26.807796 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:36:26.807796 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 05:36:26.807796 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 05:36:26.807796 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 05:36:26.809265 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 05:36:26.809265 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 05:36:26.809265 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 05:36:26.809265 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 05:36:26.809265 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 05:36:26.809265 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 05:36:26.809265 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 05:36:26.809265 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2e3bce83-6dff-479d-a54c-8f660fbbcdc5 could not be found. Aug 04 05:36:26.809265 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Aug 04 05:36:26.809265 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:36:26.809265 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Aug 04 05:36:26.809265 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:36:26.809265 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:36:26.809265 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:36:26.809265 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 05:36:26.809265 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 05:36:26.809265 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2e3bce83-6dff-479d-a54c-8f660fbbcdc5 could not be found. Aug 04 05:36:26.809265 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Aug 04 05:36:26.810761 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-87f3cd63-5527-4fd4-89f3-31d3b40b0d1d tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] Returning 404 to user: Instance 2e3bce83-6dff-479d-a54c-8f660fbbcdc5 could not be found. {{(pid=118477) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 05:36:26.810761 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-87f3cd63-5527-4fd4-89f3-31d3b40b0d1d tempest-AttachVolumeShelveTestJSON-1441164991 tempest-AttachVolumeShelveTestJSON-1441164991-project] 10.222.0.46 "GET /compute/v2.1/servers/2e3bce83-6dff-479d-a54c-8f660fbbcdc5" status: 404 len: 111 microversion: 2.20 time: 0.030618 Aug 04 05:36:26.810761 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 509/1004] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Aug 4 05:36:26 2022] GET /compute/v2.1/servers/2e3bce83-6dff-479d-a54c-8f660fbbcdc5 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 04 05:36:32.274007 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-670e0d12-8fe7-424f-8721-78f1b85df098 tempest-VolumesGetTestJSON-880620636 tempest-VolumesGetTestJSON-880620636-project] Action: 'create', calling method: .version_select at 0x7f14754085e0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1215771834", "metadata": {"Type": "work"}}} {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:36:32.919233 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-670e0d12-8fe7-424f-8721-78f1b85df098 tempest-VolumesGetTestJSON-880620636 tempest-VolumesGetTestJSON-880620636-project] 10.222.0.46 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 0.762997 Aug 04 05:36:32.919867 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 496/1005] 10.222.0.46 () {60 vars in 1156 bytes} [Thu Aug 4 05:36:32 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 764 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 04 05:36:32.932660 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-c9167faa-78f7-460b-b5ba-d408c03f79d6 tempest-VolumesGetTestJSON-880620636 tempest-VolumesGetTestJSON-880620636-project] Calling method '.version_select at 0x7f14756e9a60>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:36:33.003434 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-c9167faa-78f7-460b-b5ba-d408c03f79d6 tempest-VolumesGetTestJSON-880620636 tempest-VolumesGetTestJSON-880620636-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/98e87e14-cce3-4ab3-aa4c-d6ff6ee0126c" status: 200 len: 353 microversion: 2.1 time: 0.075155 Aug 04 05:36:33.004120 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 510/1006] 10.222.0.46 () {58 vars in 1245 bytes} [Thu Aug 4 05:36:32 2022] GET /compute/v2.1/os-volumes/98e87e14-cce3-4ab3-aa4c-d6ff6ee0126c => generated 353 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:36:34.018059 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-05690040-7fbf-42fd-b2ea-27f09d52fd4c tempest-VolumesGetTestJSON-880620636 tempest-VolumesGetTestJSON-880620636-project] Calling method '.version_select at 0x7f1475f4cf70>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:36:34.064245 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-05690040-7fbf-42fd-b2ea-27f09d52fd4c tempest-VolumesGetTestJSON-880620636 tempest-VolumesGetTestJSON-880620636-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/98e87e14-cce3-4ab3-aa4c-d6ff6ee0126c" status: 200 len: 354 microversion: 2.1 time: 0.050422 Aug 04 05:36:34.064813 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 497/1007] 10.222.0.46 () {58 vars in 1245 bytes} [Thu Aug 4 05:36:34 2022] GET /compute/v2.1/os-volumes/98e87e14-cce3-4ab3-aa4c-d6ff6ee0126c => generated 354 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:36:34.077598 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-14b35798-ba45-4eb9-90db-bc69d3b55196 tempest-VolumesGetTestJSON-880620636 tempest-VolumesGetTestJSON-880620636-project] Calling method '.version_select at 0x7f14753ca430>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:36:34.125245 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-14b35798-ba45-4eb9-90db-bc69d3b55196 tempest-VolumesGetTestJSON-880620636 tempest-VolumesGetTestJSON-880620636-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/98e87e14-cce3-4ab3-aa4c-d6ff6ee0126c" status: 200 len: 354 microversion: 2.1 time: 0.051838 Aug 04 05:36:34.125805 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 511/1008] 10.222.0.46 () {58 vars in 1245 bytes} [Thu Aug 4 05:36:34 2022] GET /compute/v2.1/os-volumes/98e87e14-cce3-4ab3-aa4c-d6ff6ee0126c => generated 354 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:36:34.143475 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-712a39c7-31be-4b36-bf4c-221d829de3ee tempest-VolumesGetTestJSON-880620636 tempest-VolumesGetTestJSON-880620636-project] Calling method '.version_select at 0x7f1475e97820>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:36:34.341607 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-712a39c7-31be-4b36-bf4c-221d829de3ee tempest-VolumesGetTestJSON-880620636 tempest-VolumesGetTestJSON-880620636-project] 10.222.0.46 "DELETE /compute/v2.1/os-volumes/98e87e14-cce3-4ab3-aa4c-d6ff6ee0126c" status: 202 len: 0 microversion: 2.1 time: 0.201862 Aug 04 05:36:34.342675 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 498/1009] 10.222.0.46 () {58 vars in 1248 bytes} [Thu Aug 4 05:36:34 2022] DELETE /compute/v2.1/os-volumes/98e87e14-cce3-4ab3-aa4c-d6ff6ee0126c => generated 0 bytes in 204 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 05:36:34.351339 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-37301319-b070-4921-8a8f-971ece7c23de tempest-VolumesGetTestJSON-880620636 tempest-VolumesGetTestJSON-880620636-project] Calling method '.version_select at 0x7f14756745e0>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:36:34.404172 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-37301319-b070-4921-8a8f-971ece7c23de tempest-VolumesGetTestJSON-880620636 tempest-VolumesGetTestJSON-880620636-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/98e87e14-cce3-4ab3-aa4c-d6ff6ee0126c" status: 200 len: 353 microversion: 2.1 time: 0.057359 Aug 04 05:36:34.404745 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 512/1010] 10.222.0.46 () {58 vars in 1245 bytes} [Thu Aug 4 05:36:34 2022] GET /compute/v2.1/os-volumes/98e87e14-cce3-4ab3-aa4c-d6ff6ee0126c => generated 353 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:36:35.419459 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-4a97fd3c-99db-47e9-a3f9-0d7418afc0d8 tempest-VolumesGetTestJSON-880620636 tempest-VolumesGetTestJSON-880620636-project] Calling method '.version_select at 0x7f14753bea60>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:36:35.447704 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.wsgi [None req-4a97fd3c-99db-47e9-a3f9-0d7418afc0d8 tempest-VolumesGetTestJSON-880620636 tempest-VolumesGetTestJSON-880620636-project] HTTP exception thrown: Volume 98e87e14-cce3-4ab3-aa4c-d6ff6ee0126c could not be found. Aug 04 05:36:35.449667 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-4a97fd3c-99db-47e9-a3f9-0d7418afc0d8 tempest-VolumesGetTestJSON-880620636 tempest-VolumesGetTestJSON-880620636-project] Request method failure captured: Aug 04 05:36:35.449667 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: request: GET /compute/v2.1/os-volumes/98e87e14-cce3-4ab3-aa4c-d6ff6ee0126c HTTP/1.1 Aug 04 05:36:35.449667 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: Accept: application/json Aug 04 05:36:35.449667 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: Accept-Encoding: identity Aug 04 05:36:35.449667 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: Connection: close Aug 04 05:36:35.449667 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: Content-Length: 0 Aug 04 05:36:35.449667 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: Content-Type: application/json Aug 04 05:36:35.449667 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: Host: 10.222.0.46 Aug 04 05:36:35.449667 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: Openstack-System-Scope: None Aug 04 05:36:35.449667 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: User-Agent: python-urllib3/1.26.11 Aug 04 05:36:35.449667 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Auth-Token: gAAAAABi61rg-91lF7AfKxxjP8vtzC19VTlvZWrAWteRy0sxmNruGdejuRj7tnk0_mcCZyAFOKnQ8YHXohwVZs5gpp_9vn4KZY-Tpmp_rmODKnFMh-ufV2hXEgBObak6QSTTh8L5ECOMVhMJYpLbbbafnrnxMci6onrcsUi8kjhwNV7uHAW1ESw Aug 04 05:36:35.449667 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Domain-Id: None Aug 04 05:36:35.449667 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Domain-Name: None Aug 04 05:36:35.449667 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Identity-Status: Confirmed Aug 04 05:36:35.449667 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Is-Admin-Project: True Aug 04 05:36:35.449667 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Project-Domain-Id: default Aug 04 05:36:35.449667 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Project-Domain-Name: Default Aug 04 05:36:35.449667 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Project-Id: 5bf7bf7f733b486eafb8b3ebd3523639 Aug 04 05:36:35.449667 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Project-Name: tempest-VolumesGetTestJSON-880620636 Aug 04 05:36:35.449667 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Role: member,reader Aug 04 05:36:35.449667 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Roles: member,reader Aug 04 05:36:35.451382 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/5bf7bf7f733b486eafb8b3ebd3523639"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/5bf7bf7f733b486eafb8b3ebd3523639"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_5bf7bf7f733b486eafb8b3ebd3523639", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/5bf7bf7f733b486eafb8b3ebd3523639"}]}] Aug 04 05:36:35.451382 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Tenant: tempest-VolumesGetTestJSON-880620636 Aug 04 05:36:35.451382 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Tenant-Id: 5bf7bf7f733b486eafb8b3ebd3523639 Aug 04 05:36:35.451382 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Tenant-Name: tempest-VolumesGetTestJSON-880620636 Aug 04 05:36:35.451382 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-User: tempest-VolumesGetTestJSON-880620636-project Aug 04 05:36:35.451382 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-User-Domain-Id: default Aug 04 05:36:35.451382 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-User-Domain-Name: Default Aug 04 05:36:35.451382 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-User-Id: a09a013d420a42c9bcc21c25b20a663c Aug 04 05:36:35.451382 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-User-Name: tempest-VolumesGetTestJSON-880620636-project Aug 04 05:36:35.451382 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: method: Aug 04 05:36:35.451382 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: exception: Volume 98e87e14-cce3-4ab3-aa4c-d6ff6ee0126c could not be found. Aug 04 05:36:35.451382 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: action_args: {'id': '98e87e14-cce3-4ab3-aa4c-d6ff6ee0126c'} Aug 04 05:36:35.451382 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 05:36:35.453317 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:36:35.453317 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 04 05:36:35.453317 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 04 05:36:35.453317 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 04 05:36:35.453317 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 04 05:36:35.453317 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 04 05:36:35.453317 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 04 05:36:35.453317 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 04 05:36:35.453317 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 04 05:36:35.453317 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 04 05:36:35.453317 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 04 05:36:35.453317 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 04 05:36:35.453317 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 04 05:36:35.453317 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 04 05:36:35.453317 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 04 05:36:35.453317 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 98e87e14-cce3-4ab3-aa4c-d6ff6ee0126c could not be found. (HTTP 404) (Request-ID: req-d6084671-e587-4b4a-a3d5-a5a78d22697b) Aug 04 05:36:35.453317 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Aug 04 05:36:35.453317 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:36:35.453317 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Aug 04 05:36:35.454814 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:36:35.454814 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 04 05:36:35.454814 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 04 05:36:35.454814 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 04 05:36:35.454814 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 04 05:36:35.454814 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 04 05:36:35.454814 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 04 05:36:35.454814 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 04 05:36:35.454814 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 04 05:36:35.454814 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 04 05:36:35.454814 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 04 05:36:35.454814 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 04 05:36:35.454814 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 04 05:36:35.454814 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 04 05:36:35.454814 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 04 05:36:35.454814 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 04 05:36:35.454814 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 04 05:36:35.454814 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 04 05:36:35.454814 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 04 05:36:35.456336 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 04 05:36:35.456336 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 04 05:36:35.456336 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 04 05:36:35.456336 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 04 05:36:35.456336 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 98e87e14-cce3-4ab3-aa4c-d6ff6ee0126c could not be found. Aug 04 05:36:35.456336 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Aug 04 05:36:35.456336 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:36:35.456336 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Aug 04 05:36:35.456336 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:36:35.456336 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:36:35.456336 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:36:35.456336 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 05:36:35.456336 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 05:36:35.456336 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 05:36:35.456336 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 05:36:35.456336 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 05:36:35.456336 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 05:36:35.456336 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 04 05:36:35.456336 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 05:36:35.458224 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 98e87e14-cce3-4ab3-aa4c-d6ff6ee0126c could not be found. Aug 04 05:36:35.458224 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Aug 04 05:36:35.458224 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:36:35.458224 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Aug 04 05:36:35.458224 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:36:35.458224 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:36:35.458224 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:36:35.458224 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 05:36:35.458224 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 05:36:35.458224 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 98e87e14-cce3-4ab3-aa4c-d6ff6ee0126c could not be found. Aug 04 05:36:35.458224 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Aug 04 05:36:35.458224 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-4a97fd3c-99db-47e9-a3f9-0d7418afc0d8 tempest-VolumesGetTestJSON-880620636 tempest-VolumesGetTestJSON-880620636-project] Returning 404 to user: Volume 98e87e14-cce3-4ab3-aa4c-d6ff6ee0126c could not be found. {{(pid=118476) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 05:36:35.458224 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-4a97fd3c-99db-47e9-a3f9-0d7418afc0d8 tempest-VolumesGetTestJSON-880620636 tempest-VolumesGetTestJSON-880620636-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/98e87e14-cce3-4ab3-aa4c-d6ff6ee0126c" status: 404 len: 109 microversion: 2.1 time: 0.036174 Aug 04 05:36:35.458224 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 499/1011] 10.222.0.46 () {58 vars in 1245 bytes} [Thu Aug 4 05:36:35 2022] GET /compute/v2.1/os-volumes/98e87e14-cce3-4ab3-aa4c-d6ff6ee0126c => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 05:36:56.479491 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 05:36:56.480014 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: Thu Aug 4 05:36:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 05:37:00.581222 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG dbcounter [-] [118477] Writing DB stats nova_api:SELECT=18,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=118477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:37:00.581975 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG dbcounter [-] [118477] Writing DB stats nova_cell1:SELECT=26,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:37:00.586300 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-88303c3d-77b8-43ae-a9ac-0772d321c384 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:37:00.586992 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-88303c3d-77b8-43ae-a9ac-0772d321c384 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] [instance: 42569e98-c703-4b76-8988-47029f786567] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:37:00.593329 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-88303c3d-77b8-43ae-a9ac-0772d321c384 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:37:00.593780 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-88303c3d-77b8-43ae-a9ac-0772d321c384 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:37:00.594573 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-88303c3d-77b8-43ae-a9ac-0772d321c384 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:37:00.595038 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-88303c3d-77b8-43ae-a9ac-0772d321c384 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:37:00.620160 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-88303c3d-77b8-43ae-a9ac-0772d321c384 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] [instance: 42569e98-c703-4b76-8988-47029f786567] Going to try to terminate instance {{(pid=118477) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 05:37:00.889418 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-88303c3d-77b8-43ae-a9ac-0772d321c384 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] 10.222.0.46 "DELETE /compute/v2.1/servers/42569e98-c703-4b76-8988-47029f786567" status: 204 len: 0 microversion: 2.1 time: 0.309273 Aug 04 05:37:00.890025 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 513/1012] 10.222.0.46 () {58 vars in 1239 bytes} [Thu Aug 4 05:37:00 2022] DELETE /compute/v2.1/servers/42569e98-c703-4b76-8988-47029f786567 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 05:37:00.895300 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG dbcounter [-] [118476] Writing DB stats nova_api:SELECT=12 {{(pid=118476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:37:00.898150 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG dbcounter [-] [118476] Writing DB stats nova_cell1:SELECT=24 {{(pid=118476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:37:00.900818 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-46aae7bd-694c-44f8-b15b-734c5b926d23 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:37:00.901413 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-46aae7bd-694c-44f8-b15b-734c5b926d23 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] [instance: 42569e98-c703-4b76-8988-47029f786567] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:37:00.907254 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-46aae7bd-694c-44f8-b15b-734c5b926d23 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:37:00.907700 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-46aae7bd-694c-44f8-b15b-734c5b926d23 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:37:00.908451 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-46aae7bd-694c-44f8-b15b-734c5b926d23 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:37:00.908883 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-46aae7bd-694c-44f8-b15b-734c5b926d23 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:37:01.043209 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-46aae7bd-694c-44f8-b15b-734c5b926d23 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ffe04946139486bb4b976cb0503e0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c37bea771e9a4c26a19ff2ea9ed9d9b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:37:01.050483 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-46aae7bd-694c-44f8-b15b-734c5b926d23 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] 10.222.0.46 "GET /compute/v2.1/servers/42569e98-c703-4b76-8988-47029f786567" status: 200 len: 1578 microversion: 2.1 time: 0.156278 Aug 04 05:37:01.052991 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 500/1013] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:37:00 2022] GET /compute/v2.1/servers/42569e98-c703-4b76-8988-47029f786567 => generated 1578 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:37:02.072099 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-e8c6779f-02fd-4d82-9be1-ad30bbfee0ac tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:37:02.072818 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-e8c6779f-02fd-4d82-9be1-ad30bbfee0ac tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] [instance: 42569e98-c703-4b76-8988-47029f786567] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:37:02.079879 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-e8c6779f-02fd-4d82-9be1-ad30bbfee0ac tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:37:02.080323 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-e8c6779f-02fd-4d82-9be1-ad30bbfee0ac tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:37:02.081102 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-e8c6779f-02fd-4d82-9be1-ad30bbfee0ac tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:37:02.081531 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-e8c6779f-02fd-4d82-9be1-ad30bbfee0ac tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:37:02.218400 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-e8c6779f-02fd-4d82-9be1-ad30bbfee0ac tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ffe04946139486bb4b976cb0503e0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c37bea771e9a4c26a19ff2ea9ed9d9b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:37:02.226320 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-e8c6779f-02fd-4d82-9be1-ad30bbfee0ac tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] 10.222.0.46 "GET /compute/v2.1/servers/42569e98-c703-4b76-8988-47029f786567" status: 200 len: 1578 microversion: 2.1 time: 0.159004 Aug 04 05:37:02.226921 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 514/1014] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:37:02 2022] GET /compute/v2.1/servers/42569e98-c703-4b76-8988-47029f786567 => generated 1578 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:37:03.247937 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-282cc64c-3d24-4570-bb8b-70fb971b8a26 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:37:03.248829 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-282cc64c-3d24-4570-bb8b-70fb971b8a26 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] [instance: 42569e98-c703-4b76-8988-47029f786567] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:37:03.260532 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-282cc64c-3d24-4570-bb8b-70fb971b8a26 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:37:03.261311 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-282cc64c-3d24-4570-bb8b-70fb971b8a26 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:37:03.262274 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-282cc64c-3d24-4570-bb8b-70fb971b8a26 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:37:03.267609 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-282cc64c-3d24-4570-bb8b-70fb971b8a26 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:37:03.357601 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-282cc64c-3d24-4570-bb8b-70fb971b8a26 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ffe04946139486bb4b976cb0503e0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c37bea771e9a4c26a19ff2ea9ed9d9b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:37:03.365260 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-282cc64c-3d24-4570-bb8b-70fb971b8a26 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] 10.222.0.46 "GET /compute/v2.1/servers/42569e98-c703-4b76-8988-47029f786567" status: 200 len: 1511 microversion: 2.1 time: 0.121631 Aug 04 05:37:03.365828 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 501/1015] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:37:03 2022] GET /compute/v2.1/servers/42569e98-c703-4b76-8988-47029f786567 => generated 1511 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:37:03.553762 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [req-0914dd18-e6b6-4a23-8323-b07c3e2bd7d7 req-247636c3-ef1c-40f9-ae61-1abd5c10d8d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "42569e98-c703-4b76-8988-47029f786567", "name": "network-vif-deleted", "tag": "2448f876-6800-42cf-9a97-b79c8970b481"}]} {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:37:03.564947 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [req-0914dd18-e6b6-4a23-8323-b07c3e2bd7d7 req-247636c3-ef1c-40f9-ae61-1abd5c10d8d6 service nova] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:37:03.565413 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [req-0914dd18-e6b6-4a23-8323-b07c3e2bd7d7 req-247636c3-ef1c-40f9-ae61-1abd5c10d8d6 service nova] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:37:03.580344 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.compute.server_external_events [req-0914dd18-e6b6-4a23-8323-b07c3e2bd7d7 req-247636c3-ef1c-40f9-ae61-1abd5c10d8d6 service nova] Creating event network-vif-deleted:2448f876-6800-42cf-9a97-b79c8970b481 for instance 42569e98-c703-4b76-8988-47029f786567 on hv-cinder-85207 Aug 04 05:37:03.585616 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [req-0914dd18-e6b6-4a23-8323-b07c3e2bd7d7 req-247636c3-ef1c-40f9-ae61-1abd5c10d8d6 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036215 Aug 04 05:37:03.586995 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 515/1016] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Aug 4 05:37:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:37:04.389865 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-86cf85ee-5fc1-4497-b3db-5f6fc464e8d5 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:37:04.390499 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-86cf85ee-5fc1-4497-b3db-5f6fc464e8d5 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] [instance: 42569e98-c703-4b76-8988-47029f786567] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:37:04.397156 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-86cf85ee-5fc1-4497-b3db-5f6fc464e8d5 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:37:04.397640 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-86cf85ee-5fc1-4497-b3db-5f6fc464e8d5 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:37:04.398452 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-86cf85ee-5fc1-4497-b3db-5f6fc464e8d5 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:37:04.398878 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-86cf85ee-5fc1-4497-b3db-5f6fc464e8d5 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:37:04.432136 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-86cf85ee-5fc1-4497-b3db-5f6fc464e8d5 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:37:04.432585 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-86cf85ee-5fc1-4497-b3db-5f6fc464e8d5 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:37:04.433032 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.objects.instance [None req-86cf85ee-5fc1-4497-b3db-5f6fc464e8d5 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Lazy-loading 'fault' on Instance uuid 42569e98-c703-4b76-8988-47029f786567 {{(pid=118476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 05:37:04.477568 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-86cf85ee-5fc1-4497-b3db-5f6fc464e8d5 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ffe04946139486bb4b976cb0503e0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c37bea771e9a4c26a19ff2ea9ed9d9b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:37:04.485311 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-86cf85ee-5fc1-4497-b3db-5f6fc464e8d5 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] 10.222.0.46 "GET /compute/v2.1/servers/42569e98-c703-4b76-8988-47029f786567" status: 200 len: 1231 microversion: 2.1 time: 0.099449 Aug 04 05:37:04.486079 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 502/1017] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:37:04 2022] GET /compute/v2.1/servers/42569e98-c703-4b76-8988-47029f786567 => generated 1231 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:37:05.509580 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-2ea64f5d-bc58-469b-b39c-fd8df45a8fb2 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:37:05.510187 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-2ea64f5d-bc58-469b-b39c-fd8df45a8fb2 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] [instance: 42569e98-c703-4b76-8988-47029f786567] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:37:05.516930 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-2ea64f5d-bc58-469b-b39c-fd8df45a8fb2 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:37:05.517369 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-2ea64f5d-bc58-469b-b39c-fd8df45a8fb2 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:37:05.518116 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-2ea64f5d-bc58-469b-b39c-fd8df45a8fb2 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:37:05.518574 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-2ea64f5d-bc58-469b-b39c-fd8df45a8fb2 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:37:05.532557 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.wsgi [None req-2ea64f5d-bc58-469b-b39c-fd8df45a8fb2 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] HTTP exception thrown: Instance 42569e98-c703-4b76-8988-47029f786567 could not be found. Aug 04 05:37:05.534186 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-2ea64f5d-bc58-469b-b39c-fd8df45a8fb2 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Request method failure captured: Aug 04 05:37:05.534186 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: request: GET /compute/v2.1/servers/42569e98-c703-4b76-8988-47029f786567 HTTP/1.1 Aug 04 05:37:05.534186 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: Accept: application/json Aug 04 05:37:05.534186 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: Accept-Encoding: identity Aug 04 05:37:05.534186 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: Connection: close Aug 04 05:37:05.534186 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: Content-Length: 0 Aug 04 05:37:05.534186 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: Content-Type: application/json Aug 04 05:37:05.534186 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: Host: 10.222.0.46 Aug 04 05:37:05.534186 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: Openstack-System-Scope: None Aug 04 05:37:05.534186 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: User-Agent: python-urllib3/1.26.11 Aug 04 05:37:05.534186 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Auth-Token: gAAAAABi61pYvx3dS9u4vxk8gLHoxOEk4CNZqQKH6zCkbT29GENfbkkacpdsTIXgj1467iXjea5SO3HK7aggn_GgYiFd0uVYEHt3ICpPoC7qXIDGU8tUx2lDjPs2Inox06ZyU0ZYM8CsnwC6lyX9ku6_UWl_mzqFlVdyHqiHZh9ayVz7tHGScuU Aug 04 05:37:05.534186 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Domain-Id: None Aug 04 05:37:05.534186 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Domain-Name: None Aug 04 05:37:05.534186 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Identity-Status: Confirmed Aug 04 05:37:05.534186 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Is-Admin-Project: True Aug 04 05:37:05.534186 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Project-Domain-Id: default Aug 04 05:37:05.534186 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Project-Domain-Name: Default Aug 04 05:37:05.534186 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Project-Id: c37bea771e9a4c26a19ff2ea9ed9d9b4 Aug 04 05:37:05.534186 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Project-Name: tempest-TestVolumeBootPattern-525009811 Aug 04 05:37:05.534186 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Role: member,reader Aug 04 05:37:05.534186 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Roles: member,reader Aug 04 05:37:05.538684 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/c37bea771e9a4c26a19ff2ea9ed9d9b4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/c37bea771e9a4c26a19ff2ea9ed9d9b4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_c37bea771e9a4c26a19ff2ea9ed9d9b4", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/c37bea771e9a4c26a19ff2ea9ed9d9b4"}]}] Aug 04 05:37:05.538684 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Tenant: tempest-TestVolumeBootPattern-525009811 Aug 04 05:37:05.538684 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Tenant-Id: c37bea771e9a4c26a19ff2ea9ed9d9b4 Aug 04 05:37:05.538684 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Tenant-Name: tempest-TestVolumeBootPattern-525009811 Aug 04 05:37:05.538684 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-User: tempest-TestVolumeBootPattern-525009811-project Aug 04 05:37:05.538684 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-User-Domain-Id: default Aug 04 05:37:05.538684 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-User-Domain-Name: Default Aug 04 05:37:05.538684 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-User-Id: 5ffe04946139486bb4b976cb0503e0aa Aug 04 05:37:05.538684 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-User-Name: tempest-TestVolumeBootPattern-525009811-project Aug 04 05:37:05.538684 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: method: > Aug 04 05:37:05.538684 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: exception: Instance 42569e98-c703-4b76-8988-47029f786567 could not be found. Aug 04 05:37:05.538684 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: action_args: {'id': '42569e98-c703-4b76-8988-47029f786567'} Aug 04 05:37:05.539585 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 05:37:05.539585 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:37:05.539585 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 05:37:05.539585 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 05:37:05.539585 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 05:37:05.539585 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 05:37:05.539585 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 05:37:05.539585 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 05:37:05.539585 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 05:37:05.539585 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 05:37:05.539585 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 42569e98-c703-4b76-8988-47029f786567 could not be found. Aug 04 05:37:05.539585 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Aug 04 05:37:05.539585 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:37:05.539585 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Aug 04 05:37:05.539585 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:37:05.539585 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:37:05.539585 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:37:05.539585 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 05:37:05.539585 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 05:37:05.539585 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 05:37:05.540971 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 05:37:05.540971 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 05:37:05.540971 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 05:37:05.540971 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 05:37:05.540971 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 05:37:05.540971 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 05:37:05.540971 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 05:37:05.540971 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 42569e98-c703-4b76-8988-47029f786567 could not be found. Aug 04 05:37:05.540971 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Aug 04 05:37:05.540971 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:37:05.540971 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Aug 04 05:37:05.540971 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:37:05.540971 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:37:05.540971 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:37:05.540971 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 05:37:05.540971 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 05:37:05.540971 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 42569e98-c703-4b76-8988-47029f786567 could not be found. Aug 04 05:37:05.540971 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Aug 04 05:37:05.542155 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-2ea64f5d-bc58-469b-b39c-fd8df45a8fb2 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Returning 404 to user: Instance 42569e98-c703-4b76-8988-47029f786567 could not be found. {{(pid=118477) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 05:37:05.542155 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-2ea64f5d-bc58-469b-b39c-fd8df45a8fb2 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] 10.222.0.46 "GET /compute/v2.1/servers/42569e98-c703-4b76-8988-47029f786567" status: 404 len: 111 microversion: 2.1 time: 0.030784 Aug 04 05:37:05.542155 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 516/1018] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:37:05 2022] GET /compute/v2.1/servers/42569e98-c703-4b76-8988-47029f786567 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 05:37:05.631485 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-d013c0a1-888c-4412-8379-8870e4fa6d6c tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-506392146", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1497229411", "security_groups": [{"name": "tempest-secgroup-smoke-457367990"}], "block_device_mapping_v2": [{"uuid": "052f4806-21d9-4e10-887c-eaab09104132", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "999bb983-d3f9-4c98-9b4a-52666f821973"}]}} {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:37:05.744457 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.network.neutron [None req-d013c0a1-888c-4412-8379-8870e4fa6d6c tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] validate_networks() for [('999bb983-d3f9-4c98-9b4a-52666f821973', None, None, None, None, None)] {{(pid=118476) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 05:37:06.222158 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.virt.hardware [None req-d013c0a1-888c-4412-8379-8870e4fa6d6c tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Flavor limits 0:0:0 {{(pid=118476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 05:37:06.222599 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.virt.hardware [None req-d013c0a1-888c-4412-8379-8870e4fa6d6c tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Image limits 0:0:0 {{(pid=118476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 05:37:06.223069 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.virt.hardware [None req-d013c0a1-888c-4412-8379-8870e4fa6d6c tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Flavor pref 0:0:0 {{(pid=118476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 05:37:06.223470 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.virt.hardware [None req-d013c0a1-888c-4412-8379-8870e4fa6d6c tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Image pref 0:0:0 {{(pid=118476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 05:37:06.223877 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.virt.hardware [None req-d013c0a1-888c-4412-8379-8870e4fa6d6c tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 05:37:06.232599 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-d013c0a1-888c-4412-8379-8870e4fa6d6c tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:37:06.233041 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-d013c0a1-888c-4412-8379-8870e4fa6d6c tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:37:06.233826 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-d013c0a1-888c-4412-8379-8870e4fa6d6c tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:37:06.234255 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-d013c0a1-888c-4412-8379-8870e4fa6d6c tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:37:06.250079 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.quota [None req-d013c0a1-888c-4412-8379-8870e4fa6d6c tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Getting quotas for project c37bea771e9a4c26a19ff2ea9ed9d9b4. Resources: {'instances', 'cores', 'ram'} {{(pid=118476) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 05:37:06.253966 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.quota [None req-d013c0a1-888c-4412-8379-8870e4fa6d6c tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Getting quotas for user 5ffe04946139486bb4b976cb0503e0aa and project c37bea771e9a4c26a19ff2ea9ed9d9b4. Resources: {'instances', 'cores', 'ram'} {{(pid=118476) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 05:37:06.315054 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-d013c0a1-888c-4412-8379-8870e4fa6d6c tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Going to run 1 instances... {{(pid=118476) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 05:37:06.317214 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-d013c0a1-888c-4412-8379-8870e4fa6d6c tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] [instance: 35bc6986-6c52-4aee-9562-686789af824b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='052f4806-21d9-4e10-887c-eaab09104132',volume_size=None,volume_type=None)] {{(pid=118476) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 05:37:06.692132 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-d013c0a1-888c-4412-8379-8870e4fa6d6c tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.064564 Aug 04 05:37:06.693137 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 503/1019] 10.222.0.46 () {60 vars in 1147 bytes} [Thu Aug 4 05:37:05 2022] POST /compute/v2.1/servers => generated 405 bytes in 1066 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 05:37:06.704141 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-84dfb639-fd12-4f24-bdcf-37d15aa8e730 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:37:06.704766 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-84dfb639-fd12-4f24-bdcf-37d15aa8e730 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] [instance: 35bc6986-6c52-4aee-9562-686789af824b] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:37:06.759466 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-84dfb639-fd12-4f24-bdcf-37d15aa8e730 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ffe04946139486bb4b976cb0503e0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c37bea771e9a4c26a19ff2ea9ed9d9b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:37:06.766402 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-84dfb639-fd12-4f24-bdcf-37d15aa8e730 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] 10.222.0.46 "GET /compute/v2.1/servers/35bc6986-6c52-4aee-9562-686789af824b" status: 200 len: 1094 microversion: 2.1 time: 0.066190 Aug 04 05:37:06.766969 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 517/1020] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:37:06 2022] GET /compute/v2.1/servers/35bc6986-6c52-4aee-9562-686789af824b => generated 1094 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:37:07.788293 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-dedf91b4-4d97-4639-a7f8-f07d23a7e1cb tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:37:07.788950 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-dedf91b4-4d97-4639-a7f8-f07d23a7e1cb tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] [instance: 35bc6986-6c52-4aee-9562-686789af824b] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:37:07.795156 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-dedf91b4-4d97-4639-a7f8-f07d23a7e1cb tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:37:07.795608 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-dedf91b4-4d97-4639-a7f8-f07d23a7e1cb tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:37:07.796371 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-dedf91b4-4d97-4639-a7f8-f07d23a7e1cb tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:37:07.796813 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-dedf91b4-4d97-4639-a7f8-f07d23a7e1cb tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:37:07.860649 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-dedf91b4-4d97-4639-a7f8-f07d23a7e1cb tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ffe04946139486bb4b976cb0503e0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c37bea771e9a4c26a19ff2ea9ed9d9b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:37:07.868110 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-dedf91b4-4d97-4639-a7f8-f07d23a7e1cb tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] 10.222.0.46 "GET /compute/v2.1/servers/35bc6986-6c52-4aee-9562-686789af824b" status: 200 len: 1144 microversion: 2.1 time: 0.084152 Aug 04 05:37:07.868681 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 504/1021] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:37:07 2022] GET /compute/v2.1/servers/35bc6986-6c52-4aee-9562-686789af824b => generated 1144 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:37:08.889467 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-5bb445ed-9b4b-4413-b474-5a6f3a9b6b37 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:37:08.890067 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-5bb445ed-9b4b-4413-b474-5a6f3a9b6b37 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] [instance: 35bc6986-6c52-4aee-9562-686789af824b] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:37:08.897401 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-5bb445ed-9b4b-4413-b474-5a6f3a9b6b37 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:37:08.897850 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-5bb445ed-9b4b-4413-b474-5a6f3a9b6b37 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:37:08.898649 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-5bb445ed-9b4b-4413-b474-5a6f3a9b6b37 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:37:08.899087 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-5bb445ed-9b4b-4413-b474-5a6f3a9b6b37 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:37:08.958239 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-5bb445ed-9b4b-4413-b474-5a6f3a9b6b37 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ffe04946139486bb4b976cb0503e0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c37bea771e9a4c26a19ff2ea9ed9d9b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:37:08.965763 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-5bb445ed-9b4b-4413-b474-5a6f3a9b6b37 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] 10.222.0.46 "GET /compute/v2.1/servers/35bc6986-6c52-4aee-9562-686789af824b" status: 200 len: 1144 microversion: 2.1 time: 0.080264 Aug 04 05:37:08.966333 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 518/1022] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:37:08 2022] GET /compute/v2.1/servers/35bc6986-6c52-4aee-9562-686789af824b => generated 1144 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:37:09.120705 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 05:37:09.121201 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: Thu Aug 4 05:37:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 05:37:09.986918 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-63f2b074-bb22-45b2-b2f2-80933acf1783 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:37:09.987556 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-63f2b074-bb22-45b2-b2f2-80933acf1783 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] [instance: 35bc6986-6c52-4aee-9562-686789af824b] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:37:09.995248 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-63f2b074-bb22-45b2-b2f2-80933acf1783 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:37:09.995696 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-63f2b074-bb22-45b2-b2f2-80933acf1783 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:37:09.996446 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-63f2b074-bb22-45b2-b2f2-80933acf1783 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:37:09.996877 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-63f2b074-bb22-45b2-b2f2-80933acf1783 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:37:10.061173 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-63f2b074-bb22-45b2-b2f2-80933acf1783 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ffe04946139486bb4b976cb0503e0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c37bea771e9a4c26a19ff2ea9ed9d9b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:37:10.068493 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-63f2b074-bb22-45b2-b2f2-80933acf1783 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] 10.222.0.46 "GET /compute/v2.1/servers/35bc6986-6c52-4aee-9562-686789af824b" status: 200 len: 1192 microversion: 2.1 time: 0.085632 Aug 04 05:37:10.069058 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 505/1023] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:37:09 2022] GET /compute/v2.1/servers/35bc6986-6c52-4aee-9562-686789af824b => generated 1192 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:37:11.096246 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-3a537b62-691f-4348-a89a-35d74f1226f3 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:37:11.097046 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-3a537b62-691f-4348-a89a-35d74f1226f3 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] [instance: 35bc6986-6c52-4aee-9562-686789af824b] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:37:11.105284 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-3a537b62-691f-4348-a89a-35d74f1226f3 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:37:11.105886 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-3a537b62-691f-4348-a89a-35d74f1226f3 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:37:11.106626 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-3a537b62-691f-4348-a89a-35d74f1226f3 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:37:11.107210 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-3a537b62-691f-4348-a89a-35d74f1226f3 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:37:11.181812 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-3a537b62-691f-4348-a89a-35d74f1226f3 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ffe04946139486bb4b976cb0503e0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c37bea771e9a4c26a19ff2ea9ed9d9b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:37:11.189525 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-3a537b62-691f-4348-a89a-35d74f1226f3 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] 10.222.0.46 "GET /compute/v2.1/servers/35bc6986-6c52-4aee-9562-686789af824b" status: 200 len: 1210 microversion: 2.1 time: 0.097153 Aug 04 05:37:11.190335 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 519/1024] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:37:11 2022] GET /compute/v2.1/servers/35bc6986-6c52-4aee-9562-686789af824b => generated 1210 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:37:12.212386 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-481e9752-dbba-481d-8d62-67a55621a6cd tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:37:12.213127 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-481e9752-dbba-481d-8d62-67a55621a6cd tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] [instance: 35bc6986-6c52-4aee-9562-686789af824b] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:37:12.219813 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-481e9752-dbba-481d-8d62-67a55621a6cd tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:37:12.220266 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-481e9752-dbba-481d-8d62-67a55621a6cd tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:37:12.221040 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-481e9752-dbba-481d-8d62-67a55621a6cd tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:37:12.221475 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-481e9752-dbba-481d-8d62-67a55621a6cd tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:37:12.415210 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-481e9752-dbba-481d-8d62-67a55621a6cd tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ffe04946139486bb4b976cb0503e0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c37bea771e9a4c26a19ff2ea9ed9d9b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:37:12.422758 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-481e9752-dbba-481d-8d62-67a55621a6cd tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] 10.222.0.46 "GET /compute/v2.1/servers/35bc6986-6c52-4aee-9562-686789af824b" status: 200 len: 1265 microversion: 2.1 time: 0.214719 Aug 04 05:37:12.423272 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 506/1025] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:37:12 2022] GET /compute/v2.1/servers/35bc6986-6c52-4aee-9562-686789af824b => generated 1265 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:37:12.473036 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [req-d5436343-43d6-4a71-9542-7f431bef2f49 req-dd90d59a-a177-4bf2-acb6-1226c11128d8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "35bc6986-6c52-4aee-9562-686789af824b", "tag": "2afdfa4e-8c47-4ac7-a538-6e17137acea1"}]} {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:37:12.487537 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [req-d5436343-43d6-4a71-9542-7f431bef2f49 req-dd90d59a-a177-4bf2-acb6-1226c11128d8 service nova] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:37:12.487537 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [req-d5436343-43d6-4a71-9542-7f431bef2f49 req-dd90d59a-a177-4bf2-acb6-1226c11128d8 service nova] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:37:12.500797 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.compute.server_external_events [req-d5436343-43d6-4a71-9542-7f431bef2f49 req-dd90d59a-a177-4bf2-acb6-1226c11128d8 service nova] Creating event network-changed:2afdfa4e-8c47-4ac7-a538-6e17137acea1 for instance 35bc6986-6c52-4aee-9562-686789af824b on hv-cinder-85207 Aug 04 05:37:12.514995 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [req-d5436343-43d6-4a71-9542-7f431bef2f49 req-dd90d59a-a177-4bf2-acb6-1226c11128d8 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037798 Aug 04 05:37:12.514995 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 520/1026] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Aug 4 05:37:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:37:13.444386 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-15d6f3c6-c3be-4f71-8da5-c1fc312c2ace tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:37:13.445520 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-15d6f3c6-c3be-4f71-8da5-c1fc312c2ace tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] [instance: 35bc6986-6c52-4aee-9562-686789af824b] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:37:13.452136 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-15d6f3c6-c3be-4f71-8da5-c1fc312c2ace tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:37:13.452589 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-15d6f3c6-c3be-4f71-8da5-c1fc312c2ace tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:37:13.453350 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-15d6f3c6-c3be-4f71-8da5-c1fc312c2ace tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:37:13.453788 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-15d6f3c6-c3be-4f71-8da5-c1fc312c2ace tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:37:13.592372 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-15d6f3c6-c3be-4f71-8da5-c1fc312c2ace tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ffe04946139486bb4b976cb0503e0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c37bea771e9a4c26a19ff2ea9ed9d9b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:37:13.599878 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-15d6f3c6-c3be-4f71-8da5-c1fc312c2ace tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] 10.222.0.46 "GET /compute/v2.1/servers/35bc6986-6c52-4aee-9562-686789af824b" status: 200 len: 1265 microversion: 2.1 time: 0.159335 Aug 04 05:37:13.600439 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 507/1027] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:37:13 2022] GET /compute/v2.1/servers/35bc6986-6c52-4aee-9562-686789af824b => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:37:14.622792 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-a0260f6b-a4f4-4a26-81c8-ea85874b6197 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:37:14.623440 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-a0260f6b-a4f4-4a26-81c8-ea85874b6197 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] [instance: 35bc6986-6c52-4aee-9562-686789af824b] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:37:14.629503 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-a0260f6b-a4f4-4a26-81c8-ea85874b6197 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:37:14.632383 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-a0260f6b-a4f4-4a26-81c8-ea85874b6197 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:37:14.632383 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-a0260f6b-a4f4-4a26-81c8-ea85874b6197 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:37:14.632383 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-a0260f6b-a4f4-4a26-81c8-ea85874b6197 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:37:14.765208 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-a0260f6b-a4f4-4a26-81c8-ea85874b6197 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ffe04946139486bb4b976cb0503e0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c37bea771e9a4c26a19ff2ea9ed9d9b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:37:14.772470 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-a0260f6b-a4f4-4a26-81c8-ea85874b6197 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] 10.222.0.46 "GET /compute/v2.1/servers/35bc6986-6c52-4aee-9562-686789af824b" status: 200 len: 1265 microversion: 2.1 time: 0.154571 Aug 04 05:37:14.775764 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 521/1028] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:37:14 2022] GET /compute/v2.1/servers/35bc6986-6c52-4aee-9562-686789af824b => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:37:15.793511 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-48af4028-468e-4ca7-a330-23da66bd44a7 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:37:15.794115 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-48af4028-468e-4ca7-a330-23da66bd44a7 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] [instance: 35bc6986-6c52-4aee-9562-686789af824b] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:37:15.800502 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-48af4028-468e-4ca7-a330-23da66bd44a7 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:37:15.800947 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-48af4028-468e-4ca7-a330-23da66bd44a7 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:37:15.801708 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-48af4028-468e-4ca7-a330-23da66bd44a7 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:37:15.802144 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-48af4028-468e-4ca7-a330-23da66bd44a7 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:37:15.936998 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-48af4028-468e-4ca7-a330-23da66bd44a7 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ffe04946139486bb4b976cb0503e0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c37bea771e9a4c26a19ff2ea9ed9d9b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:37:15.944626 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-48af4028-468e-4ca7-a330-23da66bd44a7 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] 10.222.0.46 "GET /compute/v2.1/servers/35bc6986-6c52-4aee-9562-686789af824b" status: 200 len: 1265 microversion: 2.1 time: 0.155528 Aug 04 05:37:15.945796 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 508/1029] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:37:15 2022] GET /compute/v2.1/servers/35bc6986-6c52-4aee-9562-686789af824b => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:37:16.967312 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-cf19d572-a518-43f1-97f9-1a840ff8b258 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:37:16.968083 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-cf19d572-a518-43f1-97f9-1a840ff8b258 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] [instance: 35bc6986-6c52-4aee-9562-686789af824b] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:37:16.970649 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG dbcounter [-] [118477] Writing DB stats nova_cell0:SELECT=2 {{(pid=118477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:37:16.975739 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-cf19d572-a518-43f1-97f9-1a840ff8b258 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:37:16.978571 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-cf19d572-a518-43f1-97f9-1a840ff8b258 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:37:16.978571 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-cf19d572-a518-43f1-97f9-1a840ff8b258 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:37:16.978571 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-cf19d572-a518-43f1-97f9-1a840ff8b258 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:37:17.119260 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-cf19d572-a518-43f1-97f9-1a840ff8b258 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ffe04946139486bb4b976cb0503e0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c37bea771e9a4c26a19ff2ea9ed9d9b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:37:17.127376 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-cf19d572-a518-43f1-97f9-1a840ff8b258 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] 10.222.0.46 "GET /compute/v2.1/servers/35bc6986-6c52-4aee-9562-686789af824b" status: 200 len: 1265 microversion: 2.1 time: 0.163923 Aug 04 05:37:17.127952 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 522/1030] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:37:16 2022] GET /compute/v2.1/servers/35bc6986-6c52-4aee-9562-686789af824b => generated 1265 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:37:18.149267 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-8880eb48-4f03-4d3d-abc7-033423ef90e9 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:37:18.149883 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-8880eb48-4f03-4d3d-abc7-033423ef90e9 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] [instance: 35bc6986-6c52-4aee-9562-686789af824b] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:37:18.152462 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG dbcounter [-] [118476] Writing DB stats nova_cell0:SELECT=2 {{(pid=118476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:37:18.153232 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG dbcounter [-] [118476] Writing DB stats nova_cell0:SELECT=6 {{(pid=118476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:37:18.159351 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-8880eb48-4f03-4d3d-abc7-033423ef90e9 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:37:18.159798 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-8880eb48-4f03-4d3d-abc7-033423ef90e9 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:37:18.173364 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-8880eb48-4f03-4d3d-abc7-033423ef90e9 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:37:18.173364 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-8880eb48-4f03-4d3d-abc7-033423ef90e9 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:37:18.294126 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-8880eb48-4f03-4d3d-abc7-033423ef90e9 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ffe04946139486bb4b976cb0503e0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c37bea771e9a4c26a19ff2ea9ed9d9b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:37:18.301502 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-8880eb48-4f03-4d3d-abc7-033423ef90e9 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] 10.222.0.46 "GET /compute/v2.1/servers/35bc6986-6c52-4aee-9562-686789af824b" status: 200 len: 1265 microversion: 2.1 time: 0.156360 Aug 04 05:37:18.302069 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 509/1031] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:37:18 2022] GET /compute/v2.1/servers/35bc6986-6c52-4aee-9562-686789af824b => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:37:19.323941 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-13c0756e-a8a0-40a4-9659-6e05dcaa0069 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:37:19.324572 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-13c0756e-a8a0-40a4-9659-6e05dcaa0069 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] [instance: 35bc6986-6c52-4aee-9562-686789af824b] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:37:19.331027 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-13c0756e-a8a0-40a4-9659-6e05dcaa0069 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:37:19.331470 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-13c0756e-a8a0-40a4-9659-6e05dcaa0069 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:37:19.332222 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-13c0756e-a8a0-40a4-9659-6e05dcaa0069 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:37:19.332653 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-13c0756e-a8a0-40a4-9659-6e05dcaa0069 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:37:19.473690 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-13c0756e-a8a0-40a4-9659-6e05dcaa0069 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ffe04946139486bb4b976cb0503e0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c37bea771e9a4c26a19ff2ea9ed9d9b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:37:19.482061 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-13c0756e-a8a0-40a4-9659-6e05dcaa0069 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] 10.222.0.46 "GET /compute/v2.1/servers/35bc6986-6c52-4aee-9562-686789af824b" status: 200 len: 1265 microversion: 2.1 time: 0.162850 Aug 04 05:37:19.482655 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 523/1032] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:37:19 2022] GET /compute/v2.1/servers/35bc6986-6c52-4aee-9562-686789af824b => generated 1265 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:37:20.503775 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-ff9c1e22-4b5c-4709-b08d-fc046d957939 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:37:20.504377 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-ff9c1e22-4b5c-4709-b08d-fc046d957939 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] [instance: 35bc6986-6c52-4aee-9562-686789af824b] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:37:20.511573 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-ff9c1e22-4b5c-4709-b08d-fc046d957939 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:37:20.512024 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-ff9c1e22-4b5c-4709-b08d-fc046d957939 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:37:20.512969 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-ff9c1e22-4b5c-4709-b08d-fc046d957939 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:37:20.513816 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-ff9c1e22-4b5c-4709-b08d-fc046d957939 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:37:20.647129 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-ff9c1e22-4b5c-4709-b08d-fc046d957939 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ffe04946139486bb4b976cb0503e0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c37bea771e9a4c26a19ff2ea9ed9d9b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:37:20.654887 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-ff9c1e22-4b5c-4709-b08d-fc046d957939 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] 10.222.0.46 "GET /compute/v2.1/servers/35bc6986-6c52-4aee-9562-686789af824b" status: 200 len: 1265 microversion: 2.1 time: 0.155086 Aug 04 05:37:20.655450 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 510/1033] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:37:20 2022] GET /compute/v2.1/servers/35bc6986-6c52-4aee-9562-686789af824b => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:37:21.675827 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-27d6f5cb-d110-45cd-b490-3b7481095c2c tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:37:21.676457 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-27d6f5cb-d110-45cd-b490-3b7481095c2c tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] [instance: 35bc6986-6c52-4aee-9562-686789af824b] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:37:21.683532 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-27d6f5cb-d110-45cd-b490-3b7481095c2c tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:37:21.683977 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-27d6f5cb-d110-45cd-b490-3b7481095c2c tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:37:21.684731 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-27d6f5cb-d110-45cd-b490-3b7481095c2c tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:37:21.685168 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-27d6f5cb-d110-45cd-b490-3b7481095c2c tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:37:21.827193 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-27d6f5cb-d110-45cd-b490-3b7481095c2c tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ffe04946139486bb4b976cb0503e0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c37bea771e9a4c26a19ff2ea9ed9d9b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:37:21.829305 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-27d6f5cb-d110-45cd-b490-3b7481095c2c tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] 10.222.0.46 "GET /compute/v2.1/servers/35bc6986-6c52-4aee-9562-686789af824b" status: 200 len: 1265 microversion: 2.1 time: 0.157280 Aug 04 05:37:21.829922 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 524/1034] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:37:21 2022] GET /compute/v2.1/servers/35bc6986-6c52-4aee-9562-686789af824b => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 05:37:22.129950 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [req-cb046ef7-577a-406e-9aae-b6936e36d9fd req-a3107a57-720e-4dde-bc24-3c7e00ddd494 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "35bc6986-6c52-4aee-9562-686789af824b", "name": "network-vif-plugged", "status": "completed", "tag": "2afdfa4e-8c47-4ac7-a538-6e17137acea1"}]} {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:37:22.141112 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [req-cb046ef7-577a-406e-9aae-b6936e36d9fd req-a3107a57-720e-4dde-bc24-3c7e00ddd494 service nova] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:37:22.141592 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [req-cb046ef7-577a-406e-9aae-b6936e36d9fd req-a3107a57-720e-4dde-bc24-3c7e00ddd494 service nova] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:37:22.156682 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.compute.server_external_events [req-cb046ef7-577a-406e-9aae-b6936e36d9fd req-a3107a57-720e-4dde-bc24-3c7e00ddd494 service nova] Creating event network-vif-plugged:2afdfa4e-8c47-4ac7-a538-6e17137acea1 for instance 35bc6986-6c52-4aee-9562-686789af824b on hv-cinder-85207 Aug 04 05:37:22.163188 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [req-cb046ef7-577a-406e-9aae-b6936e36d9fd req-a3107a57-720e-4dde-bc24-3c7e00ddd494 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.167653 Aug 04 05:37:22.164786 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 511/1035] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Aug 4 05:37:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:37:22.850208 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-2a727e4c-fc85-4773-9b5c-b13a1710ba87 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:37:22.850809 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-2a727e4c-fc85-4773-9b5c-b13a1710ba87 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] [instance: 35bc6986-6c52-4aee-9562-686789af824b] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:37:22.857917 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-2a727e4c-fc85-4773-9b5c-b13a1710ba87 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:37:22.858394 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-2a727e4c-fc85-4773-9b5c-b13a1710ba87 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:37:22.859154 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-2a727e4c-fc85-4773-9b5c-b13a1710ba87 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:37:22.859584 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-2a727e4c-fc85-4773-9b5c-b13a1710ba87 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:37:22.995007 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-2a727e4c-fc85-4773-9b5c-b13a1710ba87 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ffe04946139486bb4b976cb0503e0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c37bea771e9a4c26a19ff2ea9ed9d9b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:37:23.002699 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-2a727e4c-fc85-4773-9b5c-b13a1710ba87 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] 10.222.0.46 "GET /compute/v2.1/servers/35bc6986-6c52-4aee-9562-686789af824b" status: 200 len: 1265 microversion: 2.1 time: 0.156301 Aug 04 05:37:23.003258 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 525/1036] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:37:22 2022] GET /compute/v2.1/servers/35bc6986-6c52-4aee-9562-686789af824b => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:37:24.025254 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-738bdc75-bb88-4b94-aaf6-90d7ea906978 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:37:24.025888 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-738bdc75-bb88-4b94-aaf6-90d7ea906978 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] [instance: 35bc6986-6c52-4aee-9562-686789af824b] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:37:24.032649 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-738bdc75-bb88-4b94-aaf6-90d7ea906978 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:37:24.033167 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-738bdc75-bb88-4b94-aaf6-90d7ea906978 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:37:24.033947 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-738bdc75-bb88-4b94-aaf6-90d7ea906978 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:37:24.034418 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-738bdc75-bb88-4b94-aaf6-90d7ea906978 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:37:24.172282 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-738bdc75-bb88-4b94-aaf6-90d7ea906978 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ffe04946139486bb4b976cb0503e0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c37bea771e9a4c26a19ff2ea9ed9d9b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:37:24.180211 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-738bdc75-bb88-4b94-aaf6-90d7ea906978 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] 10.222.0.46 "GET /compute/v2.1/servers/35bc6986-6c52-4aee-9562-686789af824b" status: 200 len: 1451 microversion: 2.1 time: 0.160208 Aug 04 05:37:24.180783 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 512/1037] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:37:24 2022] GET /compute/v2.1/servers/35bc6986-6c52-4aee-9562-686789af824b => generated 1451 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:37:24.201529 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-5be942bb-a0ce-4ba8-91c8-f08aca1944e8 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:37:24.202136 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-5be942bb-a0ce-4ba8-91c8-f08aca1944e8 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] [instance: 35bc6986-6c52-4aee-9562-686789af824b] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:37:24.208604 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-5be942bb-a0ce-4ba8-91c8-f08aca1944e8 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:37:24.209049 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-5be942bb-a0ce-4ba8-91c8-f08aca1944e8 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:37:24.209802 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-5be942bb-a0ce-4ba8-91c8-f08aca1944e8 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:37:24.210240 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-5be942bb-a0ce-4ba8-91c8-f08aca1944e8 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:37:24.347204 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-5be942bb-a0ce-4ba8-91c8-f08aca1944e8 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ffe04946139486bb4b976cb0503e0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c37bea771e9a4c26a19ff2ea9ed9d9b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:37:24.355620 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-5be942bb-a0ce-4ba8-91c8-f08aca1944e8 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] 10.222.0.46 "GET /compute/v2.1/servers/35bc6986-6c52-4aee-9562-686789af824b" status: 200 len: 1451 microversion: 2.1 time: 0.157887 Aug 04 05:37:24.356200 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 526/1038] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:37:24 2022] GET /compute/v2.1/servers/35bc6986-6c52-4aee-9562-686789af824b => generated 1451 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 05:37:26.578999 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [req-a0524559-dddd-473b-afaf-7f521f96c9be req-7be87bb0-3632-43aa-b007-e004c678d2c2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "35bc6986-6c52-4aee-9562-686789af824b", "tag": "2afdfa4e-8c47-4ac7-a538-6e17137acea1"}]} {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:37:26.589280 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [req-a0524559-dddd-473b-afaf-7f521f96c9be req-7be87bb0-3632-43aa-b007-e004c678d2c2 service nova] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:37:26.589792 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [req-a0524559-dddd-473b-afaf-7f521f96c9be req-7be87bb0-3632-43aa-b007-e004c678d2c2 service nova] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:37:26.600967 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.compute.server_external_events [req-a0524559-dddd-473b-afaf-7f521f96c9be req-7be87bb0-3632-43aa-b007-e004c678d2c2 service nova] Creating event network-changed:2afdfa4e-8c47-4ac7-a538-6e17137acea1 for instance 35bc6986-6c52-4aee-9562-686789af824b on hv-cinder-85207 Aug 04 05:37:26.607034 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [req-a0524559-dddd-473b-afaf-7f521f96c9be req-7be87bb0-3632-43aa-b007-e004c678d2c2 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088269 Aug 04 05:37:26.607951 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 513/1039] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Aug 4 05:37:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:38:00.164632 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-876ccd2d-8d61-4dd9-b30c-7987416f63b9 tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] Action: 'create', calling method: .version_select at 0x7f14756ddd30>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1669749350", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF2IyelcR4BnfrszX0fu42tGQKNeP7RTOgrG0y6b+SgrYsvRdf9+G0yoBi2IWr8TbXLC+It8FMMpNyedhjwGG48vtp0TnSGA3ncd9cHO4fGDarplgGlnM082qIcY7EVJQQ=="}} {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:38:00.174635 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG dbcounter [-] [118477] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=118477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:38:00.174635 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG dbcounter [-] [118477] Writing DB stats nova_cell1:SELECT=74,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:38:00.184366 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.quota [None req-876ccd2d-8d61-4dd9-b30c-7987416f63b9 tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] Getting quotas for project 49ee5ac3fb644e24973f40ede2c94de7. Resources: {'key_pairs'} {{(pid=118477) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 05:38:00.188176 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.quota [None req-876ccd2d-8d61-4dd9-b30c-7987416f63b9 tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] Getting quotas for user c8ff7be84ccd459cb7159bcffc1de249 and project 49ee5ac3fb644e24973f40ede2c94de7. Resources: {'key_pairs'} {{(pid=118477) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 05:38:00.266699 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-876ccd2d-8d61-4dd9-b30c-7987416f63b9 tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.105841 Aug 04 05:38:00.267232 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 527/1040] 10.222.0.46 () {60 vars in 1159 bytes} [Thu Aug 4 05:38:00 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:38:00.319421 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-166979bb-44fd-49aa-b688-629b8207ebb3 tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1559295984", "imageRef": "b3c43ba3-e3d5-433d-86a0-74f36105c442", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1669749350", "networks": [{"uuid": "113eca36-6733-4b41-83de-fd01632263d0"}]}} {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:38:00.328425 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG dbcounter [-] [118476] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=3 {{(pid=118476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:38:00.329081 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG dbcounter [-] [118476] Writing DB stats nova_cell1:SELECT=74 {{(pid=118476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:38:00.373101 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.network.neutron [None req-166979bb-44fd-49aa-b688-629b8207ebb3 tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] validate_networks() for [('113eca36-6733-4b41-83de-fd01632263d0', None, None, None, None, None)] {{(pid=118476) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 05:38:00.753657 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.virt.hardware [None req-166979bb-44fd-49aa-b688-629b8207ebb3 tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] Flavor limits 0:0:0 {{(pid=118476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 05:38:00.754086 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.virt.hardware [None req-166979bb-44fd-49aa-b688-629b8207ebb3 tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] Image limits 0:0:0 {{(pid=118476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 05:38:00.754602 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.virt.hardware [None req-166979bb-44fd-49aa-b688-629b8207ebb3 tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] Flavor pref 0:0:0 {{(pid=118476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 05:38:00.755044 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.virt.hardware [None req-166979bb-44fd-49aa-b688-629b8207ebb3 tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] Image pref 0:0:0 {{(pid=118476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 05:38:00.755461 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.virt.hardware [None req-166979bb-44fd-49aa-b688-629b8207ebb3 tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 05:38:00.764799 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-166979bb-44fd-49aa-b688-629b8207ebb3 tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:38:00.765250 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-166979bb-44fd-49aa-b688-629b8207ebb3 tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:38:00.766057 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-166979bb-44fd-49aa-b688-629b8207ebb3 tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:38:00.766535 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-166979bb-44fd-49aa-b688-629b8207ebb3 tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:38:00.784559 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.quota [None req-166979bb-44fd-49aa-b688-629b8207ebb3 tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] Getting quotas for project 49ee5ac3fb644e24973f40ede2c94de7. Resources: {'instances', 'cores', 'ram'} {{(pid=118476) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 05:38:00.788354 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.quota [None req-166979bb-44fd-49aa-b688-629b8207ebb3 tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] Getting quotas for user c8ff7be84ccd459cb7159bcffc1de249 and project 49ee5ac3fb644e24973f40ede2c94de7. Resources: {'instances', 'cores', 'ram'} {{(pid=118476) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 05:38:00.798866 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-166979bb-44fd-49aa-b688-629b8207ebb3 tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] Going to run 1 instances... {{(pid=118476) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 05:38:00.801138 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-166979bb-44fd-49aa-b688-629b8207ebb3 tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] [instance: e1f2a355-fc89-41b3-b51e-fe07af415279] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b3c43ba3-e3d5-433d-86a0-74f36105c442',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118476) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 05:38:00.912242 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-166979bb-44fd-49aa-b688-629b8207ebb3 tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.597154 Aug 04 05:38:00.912896 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 514/1041] 10.222.0.46 () {60 vars in 1147 bytes} [Thu Aug 4 05:38:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 599 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 05:38:00.924787 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-3c32cd41-2dc4-41e3-9162-3f5c238f925b tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:38:00.925401 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-3c32cd41-2dc4-41e3-9162-3f5c238f925b tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] [instance: e1f2a355-fc89-41b3-b51e-fe07af415279] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:38:00.990956 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-3c32cd41-2dc4-41e3-9162-3f5c238f925b tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ff7be84ccd459cb7159bcffc1de249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ee5ac3fb644e24973f40ede2c94de7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:38:00.995708 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-3c32cd41-2dc4-41e3-9162-3f5c238f925b tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] 10.222.0.46 "GET /compute/v2.1/servers/e1f2a355-fc89-41b3-b51e-fe07af415279" status: 200 len: 1259 microversion: 2.1 time: 0.075128 Aug 04 05:38:00.996301 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 528/1042] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:38:00 2022] GET /compute/v2.1/servers/e1f2a355-fc89-41b3-b51e-fe07af415279 => generated 1259 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:38:02.017842 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-35719935-80ff-4697-ab25-12f6b776ffe0 tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:38:02.018555 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-35719935-80ff-4697-ab25-12f6b776ffe0 tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] [instance: e1f2a355-fc89-41b3-b51e-fe07af415279] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:38:02.027046 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-35719935-80ff-4697-ab25-12f6b776ffe0 tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:38:02.027744 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-35719935-80ff-4697-ab25-12f6b776ffe0 tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:38:02.028717 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-35719935-80ff-4697-ab25-12f6b776ffe0 tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:38:02.029782 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-35719935-80ff-4697-ab25-12f6b776ffe0 tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:38:02.090293 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-35719935-80ff-4697-ab25-12f6b776ffe0 tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ff7be84ccd459cb7159bcffc1de249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ee5ac3fb644e24973f40ede2c94de7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:38:02.098831 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-35719935-80ff-4697-ab25-12f6b776ffe0 tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] 10.222.0.46 "GET /compute/v2.1/servers/e1f2a355-fc89-41b3-b51e-fe07af415279" status: 200 len: 1263 microversion: 2.1 time: 0.085449 Aug 04 05:38:02.102045 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 515/1043] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:38:02 2022] GET /compute/v2.1/servers/e1f2a355-fc89-41b3-b51e-fe07af415279 => generated 1263 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:38:03.120643 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-098555fc-8592-414f-8281-8d4a2b4520bb tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:38:03.121229 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-098555fc-8592-414f-8281-8d4a2b4520bb tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] [instance: e1f2a355-fc89-41b3-b51e-fe07af415279] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:38:03.128508 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-098555fc-8592-414f-8281-8d4a2b4520bb tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:38:03.130849 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-098555fc-8592-414f-8281-8d4a2b4520bb tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:38:03.130849 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-098555fc-8592-414f-8281-8d4a2b4520bb tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:38:03.130849 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-098555fc-8592-414f-8281-8d4a2b4520bb tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:38:03.196679 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-098555fc-8592-414f-8281-8d4a2b4520bb tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ff7be84ccd459cb7159bcffc1de249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ee5ac3fb644e24973f40ede2c94de7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:38:03.205184 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-098555fc-8592-414f-8281-8d4a2b4520bb tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] 10.222.0.46 "GET /compute/v2.1/servers/e1f2a355-fc89-41b3-b51e-fe07af415279" status: 200 len: 1319 microversion: 2.1 time: 0.088550 Aug 04 05:38:03.205759 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 529/1044] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:38:03 2022] GET /compute/v2.1/servers/e1f2a355-fc89-41b3-b51e-fe07af415279 => generated 1319 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:38:04.227567 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-86d4484e-67a5-431c-bf9a-2d163fb13919 tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:38:04.229024 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-86d4484e-67a5-431c-bf9a-2d163fb13919 tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] [instance: e1f2a355-fc89-41b3-b51e-fe07af415279] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:38:04.237731 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-86d4484e-67a5-431c-bf9a-2d163fb13919 tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:38:04.238738 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-86d4484e-67a5-431c-bf9a-2d163fb13919 tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:38:04.239890 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-86d4484e-67a5-431c-bf9a-2d163fb13919 tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:38:04.240539 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-86d4484e-67a5-431c-bf9a-2d163fb13919 tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:38:04.381437 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-86d4484e-67a5-431c-bf9a-2d163fb13919 tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ff7be84ccd459cb7159bcffc1de249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ee5ac3fb644e24973f40ede2c94de7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:38:04.389960 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-86d4484e-67a5-431c-bf9a-2d163fb13919 tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] 10.222.0.46 "GET /compute/v2.1/servers/e1f2a355-fc89-41b3-b51e-fe07af415279" status: 200 len: 1359 microversion: 2.1 time: 0.166442 Aug 04 05:38:04.396117 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 516/1045] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:38:04 2022] GET /compute/v2.1/servers/e1f2a355-fc89-41b3-b51e-fe07af415279 => generated 1359 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:38:05.413150 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-aafc7059-b294-4dc7-bc2f-83847524df3f tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:38:05.413860 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-aafc7059-b294-4dc7-bc2f-83847524df3f tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] [instance: e1f2a355-fc89-41b3-b51e-fe07af415279] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:38:05.421984 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-aafc7059-b294-4dc7-bc2f-83847524df3f tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:38:05.422794 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-aafc7059-b294-4dc7-bc2f-83847524df3f tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:38:05.423562 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-aafc7059-b294-4dc7-bc2f-83847524df3f tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:38:05.423986 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-aafc7059-b294-4dc7-bc2f-83847524df3f tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:38:05.566161 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-aafc7059-b294-4dc7-bc2f-83847524df3f tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ff7be84ccd459cb7159bcffc1de249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ee5ac3fb644e24973f40ede2c94de7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:38:05.574426 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-aafc7059-b294-4dc7-bc2f-83847524df3f tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] 10.222.0.46 "GET /compute/v2.1/servers/e1f2a355-fc89-41b3-b51e-fe07af415279" status: 200 len: 1359 microversion: 2.1 time: 0.165058 Aug 04 05:38:05.575202 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 530/1046] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:38:05 2022] GET /compute/v2.1/servers/e1f2a355-fc89-41b3-b51e-fe07af415279 => generated 1359 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:38:06.596054 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-654e6eb6-b3b9-4fe6-9da3-407752673542 tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:38:06.596886 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-654e6eb6-b3b9-4fe6-9da3-407752673542 tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] [instance: e1f2a355-fc89-41b3-b51e-fe07af415279] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:38:06.603706 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-654e6eb6-b3b9-4fe6-9da3-407752673542 tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:38:06.604733 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-654e6eb6-b3b9-4fe6-9da3-407752673542 tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:38:06.605590 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-654e6eb6-b3b9-4fe6-9da3-407752673542 tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:38:06.606028 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-654e6eb6-b3b9-4fe6-9da3-407752673542 tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:38:06.757562 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-654e6eb6-b3b9-4fe6-9da3-407752673542 tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ff7be84ccd459cb7159bcffc1de249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ee5ac3fb644e24973f40ede2c94de7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:38:06.765627 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-654e6eb6-b3b9-4fe6-9da3-407752673542 tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] 10.222.0.46 "GET /compute/v2.1/servers/e1f2a355-fc89-41b3-b51e-fe07af415279" status: 200 len: 1359 microversion: 2.1 time: 0.173989 Aug 04 05:38:06.766220 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 517/1047] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:38:06 2022] GET /compute/v2.1/servers/e1f2a355-fc89-41b3-b51e-fe07af415279 => generated 1359 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:38:07.789809 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-d3a10bee-434d-48f8-be29-9b1c77b4d760 tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:38:07.790554 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-d3a10bee-434d-48f8-be29-9b1c77b4d760 tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] [instance: e1f2a355-fc89-41b3-b51e-fe07af415279] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:38:07.797467 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-d3a10bee-434d-48f8-be29-9b1c77b4d760 tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:38:07.798020 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-d3a10bee-434d-48f8-be29-9b1c77b4d760 tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:38:07.798884 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-d3a10bee-434d-48f8-be29-9b1c77b4d760 tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:38:07.799390 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-d3a10bee-434d-48f8-be29-9b1c77b4d760 tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:38:07.934172 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-d3a10bee-434d-48f8-be29-9b1c77b4d760 tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ff7be84ccd459cb7159bcffc1de249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ee5ac3fb644e24973f40ede2c94de7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:38:07.942354 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-d3a10bee-434d-48f8-be29-9b1c77b4d760 tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] 10.222.0.46 "GET /compute/v2.1/servers/e1f2a355-fc89-41b3-b51e-fe07af415279" status: 200 len: 1359 microversion: 2.1 time: 0.157138 Aug 04 05:38:07.945735 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 531/1048] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:38:07 2022] GET /compute/v2.1/servers/e1f2a355-fc89-41b3-b51e-fe07af415279 => generated 1359 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:38:08.965046 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-658d61ce-1b42-4e09-960a-866f29b64b6e tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:38:08.965668 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-658d61ce-1b42-4e09-960a-866f29b64b6e tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] [instance: e1f2a355-fc89-41b3-b51e-fe07af415279] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:38:08.973227 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-658d61ce-1b42-4e09-960a-866f29b64b6e tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:38:08.973675 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-658d61ce-1b42-4e09-960a-866f29b64b6e tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:38:08.974490 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-658d61ce-1b42-4e09-960a-866f29b64b6e tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:38:08.974930 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-658d61ce-1b42-4e09-960a-866f29b64b6e tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:38:09.112751 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-658d61ce-1b42-4e09-960a-866f29b64b6e tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ff7be84ccd459cb7159bcffc1de249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ee5ac3fb644e24973f40ede2c94de7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:38:09.120759 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-658d61ce-1b42-4e09-960a-866f29b64b6e tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] 10.222.0.46 "GET /compute/v2.1/servers/e1f2a355-fc89-41b3-b51e-fe07af415279" status: 200 len: 1359 microversion: 2.1 time: 0.160235 Aug 04 05:38:09.121529 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 518/1049] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:38:08 2022] GET /compute/v2.1/servers/e1f2a355-fc89-41b3-b51e-fe07af415279 => generated 1359 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:38:10.141352 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-e2b1768b-a48c-4931-9dfc-8dc76e3a4a04 tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:38:10.142013 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-e2b1768b-a48c-4931-9dfc-8dc76e3a4a04 tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] [instance: e1f2a355-fc89-41b3-b51e-fe07af415279] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:38:10.148750 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-e2b1768b-a48c-4931-9dfc-8dc76e3a4a04 tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:38:10.149191 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-e2b1768b-a48c-4931-9dfc-8dc76e3a4a04 tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:38:10.150231 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-e2b1768b-a48c-4931-9dfc-8dc76e3a4a04 tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:38:10.151302 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-e2b1768b-a48c-4931-9dfc-8dc76e3a4a04 tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:38:10.297279 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-e2b1768b-a48c-4931-9dfc-8dc76e3a4a04 tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ff7be84ccd459cb7159bcffc1de249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ee5ac3fb644e24973f40ede2c94de7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:38:10.304902 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-e2b1768b-a48c-4931-9dfc-8dc76e3a4a04 tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] 10.222.0.46 "GET /compute/v2.1/servers/e1f2a355-fc89-41b3-b51e-fe07af415279" status: 200 len: 1359 microversion: 2.1 time: 0.167418 Aug 04 05:38:10.305477 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 532/1050] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:38:10 2022] GET /compute/v2.1/servers/e1f2a355-fc89-41b3-b51e-fe07af415279 => generated 1359 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:38:11.327149 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-48189ee8-09e5-458e-9f7a-a22de3ab9328 tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:38:11.327758 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-48189ee8-09e5-458e-9f7a-a22de3ab9328 tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] [instance: e1f2a355-fc89-41b3-b51e-fe07af415279] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:38:11.330336 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG dbcounter [-] [118476] Writing DB stats nova_cell0:SELECT=2 {{(pid=118476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:38:11.331001 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG dbcounter [-] [118476] Writing DB stats nova_cell0:SELECT=6 {{(pid=118476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:38:11.335752 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-48189ee8-09e5-458e-9f7a-a22de3ab9328 tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:38:11.336197 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-48189ee8-09e5-458e-9f7a-a22de3ab9328 tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:38:11.336972 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-48189ee8-09e5-458e-9f7a-a22de3ab9328 tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:38:11.337401 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-48189ee8-09e5-458e-9f7a-a22de3ab9328 tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:38:11.552508 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-48189ee8-09e5-458e-9f7a-a22de3ab9328 tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ff7be84ccd459cb7159bcffc1de249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ee5ac3fb644e24973f40ede2c94de7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:38:11.560611 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-48189ee8-09e5-458e-9f7a-a22de3ab9328 tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] 10.222.0.46 "GET /compute/v2.1/servers/e1f2a355-fc89-41b3-b51e-fe07af415279" status: 200 len: 1359 microversion: 2.1 time: 0.237503 Aug 04 05:38:11.561204 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 519/1051] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:38:11 2022] GET /compute/v2.1/servers/e1f2a355-fc89-41b3-b51e-fe07af415279 => generated 1359 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:38:12.127720 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [req-050b0bcb-9fac-4361-950d-f252a11173c1 req-0b29a2d4-64dd-46b4-b91f-5a0d6e6b63ac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e1f2a355-fc89-41b3-b51e-fe07af415279", "tag": "5ea44cdb-5862-4ab0-96d6-265ecda6ad7a"}]} {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:38:12.132763 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG dbcounter [-] [118477] Writing DB stats nova_cell0:SELECT=6 {{(pid=118477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:38:12.138641 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [req-050b0bcb-9fac-4361-950d-f252a11173c1 req-0b29a2d4-64dd-46b4-b91f-5a0d6e6b63ac service nova] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:38:12.140953 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [req-050b0bcb-9fac-4361-950d-f252a11173c1 req-0b29a2d4-64dd-46b4-b91f-5a0d6e6b63ac service nova] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:38:12.150870 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.compute.server_external_events [req-050b0bcb-9fac-4361-950d-f252a11173c1 req-0b29a2d4-64dd-46b4-b91f-5a0d6e6b63ac service nova] Creating event network-changed:5ea44cdb-5862-4ab0-96d6-265ecda6ad7a for instance e1f2a355-fc89-41b3-b51e-fe07af415279 on hv-cinder-85207 Aug 04 05:38:12.156065 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [req-050b0bcb-9fac-4361-950d-f252a11173c1 req-0b29a2d4-64dd-46b4-b91f-5a0d6e6b63ac service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032326 Aug 04 05:38:12.158136 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 533/1052] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Aug 4 05:38:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:38:12.581790 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-e864ac37-73e9-4aee-b44c-6d361c844eb9 tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:38:12.582433 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-e864ac37-73e9-4aee-b44c-6d361c844eb9 tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] [instance: e1f2a355-fc89-41b3-b51e-fe07af415279] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:38:12.588877 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-e864ac37-73e9-4aee-b44c-6d361c844eb9 tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:38:12.589878 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-e864ac37-73e9-4aee-b44c-6d361c844eb9 tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:38:12.590701 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-e864ac37-73e9-4aee-b44c-6d361c844eb9 tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:38:12.591138 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-e864ac37-73e9-4aee-b44c-6d361c844eb9 tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:38:12.756921 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-e864ac37-73e9-4aee-b44c-6d361c844eb9 tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ff7be84ccd459cb7159bcffc1de249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ee5ac3fb644e24973f40ede2c94de7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:38:12.765015 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-e864ac37-73e9-4aee-b44c-6d361c844eb9 tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] 10.222.0.46 "GET /compute/v2.1/servers/e1f2a355-fc89-41b3-b51e-fe07af415279" status: 200 len: 1359 microversion: 2.1 time: 0.187424 Aug 04 05:38:12.765601 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 520/1053] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:38:12 2022] GET /compute/v2.1/servers/e1f2a355-fc89-41b3-b51e-fe07af415279 => generated 1359 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:38:13.787454 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-abf98509-55bf-4871-aac4-a04cac351a3b tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:38:13.788078 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-abf98509-55bf-4871-aac4-a04cac351a3b tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] [instance: e1f2a355-fc89-41b3-b51e-fe07af415279] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:38:13.795631 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-abf98509-55bf-4871-aac4-a04cac351a3b tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:38:13.801067 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-abf98509-55bf-4871-aac4-a04cac351a3b tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:38:13.801067 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-abf98509-55bf-4871-aac4-a04cac351a3b tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:38:13.801067 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-abf98509-55bf-4871-aac4-a04cac351a3b tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:38:13.930059 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-abf98509-55bf-4871-aac4-a04cac351a3b tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ff7be84ccd459cb7159bcffc1de249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ee5ac3fb644e24973f40ede2c94de7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:38:13.937711 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-abf98509-55bf-4871-aac4-a04cac351a3b tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] 10.222.0.46 "GET /compute/v2.1/servers/e1f2a355-fc89-41b3-b51e-fe07af415279" status: 200 len: 1359 microversion: 2.1 time: 0.154433 Aug 04 05:38:13.938276 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 534/1054] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:38:13 2022] GET /compute/v2.1/servers/e1f2a355-fc89-41b3-b51e-fe07af415279 => generated 1359 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:38:14.958426 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-86634fc0-c20c-464c-a667-b57bdb13bb94 tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:38:14.959032 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-86634fc0-c20c-464c-a667-b57bdb13bb94 tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] [instance: e1f2a355-fc89-41b3-b51e-fe07af415279] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:38:14.965673 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-86634fc0-c20c-464c-a667-b57bdb13bb94 tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:38:14.966112 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-86634fc0-c20c-464c-a667-b57bdb13bb94 tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:38:14.966895 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-86634fc0-c20c-464c-a667-b57bdb13bb94 tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:38:14.967328 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-86634fc0-c20c-464c-a667-b57bdb13bb94 tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:38:15.092408 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-86634fc0-c20c-464c-a667-b57bdb13bb94 tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ff7be84ccd459cb7159bcffc1de249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ee5ac3fb644e24973f40ede2c94de7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:38:15.099709 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-86634fc0-c20c-464c-a667-b57bdb13bb94 tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] 10.222.0.46 "GET /compute/v2.1/servers/e1f2a355-fc89-41b3-b51e-fe07af415279" status: 200 len: 1359 microversion: 2.1 time: 0.145226 Aug 04 05:38:15.100274 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 521/1055] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:38:14 2022] GET /compute/v2.1/servers/e1f2a355-fc89-41b3-b51e-fe07af415279 => generated 1359 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:38:16.121958 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-fd31a99f-df24-407d-a70f-0c7f228d3f42 tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:38:16.122596 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-fd31a99f-df24-407d-a70f-0c7f228d3f42 tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] [instance: e1f2a355-fc89-41b3-b51e-fe07af415279] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:38:16.128950 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-fd31a99f-df24-407d-a70f-0c7f228d3f42 tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:38:16.129397 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-fd31a99f-df24-407d-a70f-0c7f228d3f42 tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:38:16.130155 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-fd31a99f-df24-407d-a70f-0c7f228d3f42 tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:38:16.130617 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-fd31a99f-df24-407d-a70f-0c7f228d3f42 tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:38:16.259119 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-fd31a99f-df24-407d-a70f-0c7f228d3f42 tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ff7be84ccd459cb7159bcffc1de249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ee5ac3fb644e24973f40ede2c94de7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:38:16.266619 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-fd31a99f-df24-407d-a70f-0c7f228d3f42 tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] 10.222.0.46 "GET /compute/v2.1/servers/e1f2a355-fc89-41b3-b51e-fe07af415279" status: 200 len: 1359 microversion: 2.1 time: 0.149261 Aug 04 05:38:16.267195 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 535/1056] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:38:16 2022] GET /compute/v2.1/servers/e1f2a355-fc89-41b3-b51e-fe07af415279 => generated 1359 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:38:17.288269 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-f5670a3f-8127-4c8a-930a-e67fd5a771f9 tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:38:17.288878 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-f5670a3f-8127-4c8a-930a-e67fd5a771f9 tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] [instance: e1f2a355-fc89-41b3-b51e-fe07af415279] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:38:17.295717 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-f5670a3f-8127-4c8a-930a-e67fd5a771f9 tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:38:17.296158 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-f5670a3f-8127-4c8a-930a-e67fd5a771f9 tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:38:17.296908 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-f5670a3f-8127-4c8a-930a-e67fd5a771f9 tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:38:17.297338 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-f5670a3f-8127-4c8a-930a-e67fd5a771f9 tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:38:17.426078 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-f5670a3f-8127-4c8a-930a-e67fd5a771f9 tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ff7be84ccd459cb7159bcffc1de249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ee5ac3fb644e24973f40ede2c94de7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:38:17.434171 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-f5670a3f-8127-4c8a-930a-e67fd5a771f9 tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] 10.222.0.46 "GET /compute/v2.1/servers/e1f2a355-fc89-41b3-b51e-fe07af415279" status: 200 len: 1359 microversion: 2.1 time: 0.149159 Aug 04 05:38:17.434780 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 522/1057] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:38:17 2022] GET /compute/v2.1/servers/e1f2a355-fc89-41b3-b51e-fe07af415279 => generated 1359 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:38:18.341482 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [req-f9605eac-6099-46c0-8fb5-2fe17b047aa0 req-ca47e0fa-0a00-4ca8-90f4-89d82c72160f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1f2a355-fc89-41b3-b51e-fe07af415279", "name": "network-vif-plugged", "status": "completed", "tag": "5ea44cdb-5862-4ab0-96d6-265ecda6ad7a"}]} {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:38:18.351250 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [req-f9605eac-6099-46c0-8fb5-2fe17b047aa0 req-ca47e0fa-0a00-4ca8-90f4-89d82c72160f service nova] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:38:18.351728 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [req-f9605eac-6099-46c0-8fb5-2fe17b047aa0 req-ca47e0fa-0a00-4ca8-90f4-89d82c72160f service nova] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:38:18.363122 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.compute.server_external_events [req-f9605eac-6099-46c0-8fb5-2fe17b047aa0 req-ca47e0fa-0a00-4ca8-90f4-89d82c72160f service nova] Creating event network-vif-plugged:5ea44cdb-5862-4ab0-96d6-265ecda6ad7a for instance e1f2a355-fc89-41b3-b51e-fe07af415279 on hv-cinder-85207 Aug 04 05:38:18.367420 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [req-f9605eac-6099-46c0-8fb5-2fe17b047aa0 req-ca47e0fa-0a00-4ca8-90f4-89d82c72160f service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029758 Aug 04 05:38:18.367969 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 536/1058] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Aug 4 05:38:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:38:18.455972 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-9c48358f-b1a9-4657-84b4-8191702a6846 tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:38:18.456582 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-9c48358f-b1a9-4657-84b4-8191702a6846 tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] [instance: e1f2a355-fc89-41b3-b51e-fe07af415279] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:38:18.463519 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-9c48358f-b1a9-4657-84b4-8191702a6846 tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:38:18.463976 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-9c48358f-b1a9-4657-84b4-8191702a6846 tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:38:18.464804 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-9c48358f-b1a9-4657-84b4-8191702a6846 tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:38:18.465243 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-9c48358f-b1a9-4657-84b4-8191702a6846 tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:38:18.596280 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-9c48358f-b1a9-4657-84b4-8191702a6846 tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ff7be84ccd459cb7159bcffc1de249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ee5ac3fb644e24973f40ede2c94de7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:38:18.603848 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-9c48358f-b1a9-4657-84b4-8191702a6846 tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] 10.222.0.46 "GET /compute/v2.1/servers/e1f2a355-fc89-41b3-b51e-fe07af415279" status: 200 len: 1359 microversion: 2.1 time: 0.151877 Aug 04 05:38:18.604450 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 523/1059] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:38:18 2022] GET /compute/v2.1/servers/e1f2a355-fc89-41b3-b51e-fe07af415279 => generated 1359 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:38:19.625828 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-79de1ea8-2e94-4828-822a-06a6a04cd311 tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:38:19.626556 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-79de1ea8-2e94-4828-822a-06a6a04cd311 tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] [instance: e1f2a355-fc89-41b3-b51e-fe07af415279] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:38:19.632689 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-79de1ea8-2e94-4828-822a-06a6a04cd311 tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:38:19.633134 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-79de1ea8-2e94-4828-822a-06a6a04cd311 tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:38:19.633889 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-79de1ea8-2e94-4828-822a-06a6a04cd311 tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:38:19.634346 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-79de1ea8-2e94-4828-822a-06a6a04cd311 tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:38:19.766269 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-79de1ea8-2e94-4828-822a-06a6a04cd311 tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ff7be84ccd459cb7159bcffc1de249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ee5ac3fb644e24973f40ede2c94de7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:38:19.773659 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-79de1ea8-2e94-4828-822a-06a6a04cd311 tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] 10.222.0.46 "GET /compute/v2.1/servers/e1f2a355-fc89-41b3-b51e-fe07af415279" status: 200 len: 1359 microversion: 2.1 time: 0.152756 Aug 04 05:38:19.774220 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 537/1060] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:38:19 2022] GET /compute/v2.1/servers/e1f2a355-fc89-41b3-b51e-fe07af415279 => generated 1359 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:38:20.795744 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-077c13ca-797a-4b05-b538-0843acbfad92 tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:38:20.796364 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-077c13ca-797a-4b05-b538-0843acbfad92 tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] [instance: e1f2a355-fc89-41b3-b51e-fe07af415279] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:38:20.803127 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-077c13ca-797a-4b05-b538-0843acbfad92 tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:38:20.803574 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-077c13ca-797a-4b05-b538-0843acbfad92 tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:38:20.804348 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-077c13ca-797a-4b05-b538-0843acbfad92 tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:38:20.804779 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-077c13ca-797a-4b05-b538-0843acbfad92 tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:38:21.180127 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-077c13ca-797a-4b05-b538-0843acbfad92 tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ff7be84ccd459cb7159bcffc1de249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ee5ac3fb644e24973f40ede2c94de7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:38:21.188396 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-077c13ca-797a-4b05-b538-0843acbfad92 tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] 10.222.0.46 "GET /compute/v2.1/servers/e1f2a355-fc89-41b3-b51e-fe07af415279" status: 200 len: 1550 microversion: 2.1 time: 0.397324 Aug 04 05:38:21.189101 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 524/1061] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:38:20 2022] GET /compute/v2.1/servers/e1f2a355-fc89-41b3-b51e-fe07af415279 => generated 1550 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:38:21.209127 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-c89b6921-4f46-4a09-88c2-fe2b1ddb7fca tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:38:21.209821 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-c89b6921-4f46-4a09-88c2-fe2b1ddb7fca tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] [instance: e1f2a355-fc89-41b3-b51e-fe07af415279] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:38:21.217289 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-c89b6921-4f46-4a09-88c2-fe2b1ddb7fca tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:38:21.217816 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-c89b6921-4f46-4a09-88c2-fe2b1ddb7fca tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:38:21.218607 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-c89b6921-4f46-4a09-88c2-fe2b1ddb7fca tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:38:21.219065 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-c89b6921-4f46-4a09-88c2-fe2b1ddb7fca tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:38:21.434757 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-c89b6921-4f46-4a09-88c2-fe2b1ddb7fca tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ff7be84ccd459cb7159bcffc1de249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ee5ac3fb644e24973f40ede2c94de7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:38:21.442134 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-c89b6921-4f46-4a09-88c2-fe2b1ddb7fca tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] 10.222.0.46 "GET /compute/v2.1/servers/e1f2a355-fc89-41b3-b51e-fe07af415279" status: 200 len: 1550 microversion: 2.1 time: 0.236969 Aug 04 05:38:21.442732 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 538/1062] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:38:21 2022] GET /compute/v2.1/servers/e1f2a355-fc89-41b3-b51e-fe07af415279 => generated 1550 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:38:21.461734 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-03ca0e9d-05b7-4ff3-a3ca-b8c2817bf74d tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:38:21.467190 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-03ca0e9d-05b7-4ff3-a3ca-b8c2817bf74d tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c8ff7be84ccd459cb7159bcffc1de249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ee5ac3fb644e24973f40ede2c94de7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:38:21.467988 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-03ca0e9d-05b7-4ff3-a3ca-b8c2817bf74d tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] Searching by: {'deleted': False, 'project_id': '49ee5ac3fb644e24973f40ede2c94de7'} {{(pid=118476) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 04 05:38:21.474861 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-03ca0e9d-05b7-4ff3-a3ca-b8c2817bf74d tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:38:21.475313 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-03ca0e9d-05b7-4ff3-a3ca-b8c2817bf74d tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:38:21.476117 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-03ca0e9d-05b7-4ff3-a3ca-b8c2817bf74d tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:38:21.476554 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-03ca0e9d-05b7-4ff3-a3ca-b8c2817bf74d tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:38:21.568483 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.multi_cell_list [None req-03ca0e9d-05b7-4ff3-a3ca-b8c2817bf74d tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=118476) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 04 05:38:21.666122 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-03ca0e9d-05b7-4ff3-a3ca-b8c2817bf74d tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] 10.222.0.46 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.208229 Aug 04 05:38:21.666755 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 525/1063] 10.222.0.46 () {58 vars in 1125 bytes} [Thu Aug 4 05:38:21 2022] GET /compute/v2.1/servers => generated 343 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:38:21.677853 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-42c230fd-e983-4697-9c3b-2938bc7ff4c3 tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:38:21.678495 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-42c230fd-e983-4697-9c3b-2938bc7ff4c3 tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] [instance: e1f2a355-fc89-41b3-b51e-fe07af415279] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:38:21.684991 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-42c230fd-e983-4697-9c3b-2938bc7ff4c3 tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:38:21.685426 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-42c230fd-e983-4697-9c3b-2938bc7ff4c3 tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:38:21.686170 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-42c230fd-e983-4697-9c3b-2938bc7ff4c3 tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:38:21.686635 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-42c230fd-e983-4697-9c3b-2938bc7ff4c3 tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:38:21.817667 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-42c230fd-e983-4697-9c3b-2938bc7ff4c3 tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ff7be84ccd459cb7159bcffc1de249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ee5ac3fb644e24973f40ede2c94de7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:38:21.825538 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-42c230fd-e983-4697-9c3b-2938bc7ff4c3 tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] 10.222.0.46 "GET /compute/v2.1/servers/e1f2a355-fc89-41b3-b51e-fe07af415279" status: 200 len: 1550 microversion: 2.1 time: 0.151431 Aug 04 05:38:21.826190 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 539/1064] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:38:21 2022] GET /compute/v2.1/servers/e1f2a355-fc89-41b3-b51e-fe07af415279 => generated 1550 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:38:23.560122 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-c4966b38-75a5-4b5c-bca7-1a0fb49374d7 tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ff0de8b5-a13b-4756-bc98-7b6ac1ccd046"}} {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:38:23.562480 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-c4966b38-75a5-4b5c-bca7-1a0fb49374d7 tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] [instance: e1f2a355-fc89-41b3-b51e-fe07af415279] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:38:23.569055 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-c4966b38-75a5-4b5c-bca7-1a0fb49374d7 tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:38:23.569501 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-c4966b38-75a5-4b5c-bca7-1a0fb49374d7 tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:38:23.570265 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-c4966b38-75a5-4b5c-bca7-1a0fb49374d7 tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:38:23.570731 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-c4966b38-75a5-4b5c-bca7-1a0fb49374d7 tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:38:24.331497 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-c4966b38-75a5-4b5c-bca7-1a0fb49374d7 tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] 10.222.0.46 "POST /compute/v2.1/servers/e1f2a355-fc89-41b3-b51e-fe07af415279/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.775340 Aug 04 05:38:24.332112 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 526/1065] 10.222.0.46 () {60 vars in 1323 bytes} [Thu Aug 4 05:38:23 2022] POST /compute/v2.1/servers/e1f2a355-fc89-41b3-b51e-fe07af415279/os-volume_attachments => generated 194 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:38:31.908920 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-b2fbeed0-f673-4804-82b9-91f6dbe8eba4 tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:38:31.909530 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-b2fbeed0-f673-4804-82b9-91f6dbe8eba4 tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] [instance: e1f2a355-fc89-41b3-b51e-fe07af415279] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:38:31.911794 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG dbcounter [-] [118477] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=1 {{(pid=118477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:38:31.912520 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG dbcounter [-] [118477] Writing DB stats nova_cell1:SELECT=58 {{(pid=118477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:38:31.917246 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-b2fbeed0-f673-4804-82b9-91f6dbe8eba4 tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:38:31.917832 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-b2fbeed0-f673-4804-82b9-91f6dbe8eba4 tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:38:31.918818 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-b2fbeed0-f673-4804-82b9-91f6dbe8eba4 tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:38:31.919263 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-b2fbeed0-f673-4804-82b9-91f6dbe8eba4 tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:38:32.048412 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-b2fbeed0-f673-4804-82b9-91f6dbe8eba4 tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ff7be84ccd459cb7159bcffc1de249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ee5ac3fb644e24973f40ede2c94de7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:38:32.056387 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-b2fbeed0-f673-4804-82b9-91f6dbe8eba4 tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] 10.222.0.46 "GET /compute/v2.1/servers/e1f2a355-fc89-41b3-b51e-fe07af415279" status: 200 len: 1596 microversion: 2.1 time: 0.151489 Aug 04 05:38:32.056958 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 540/1066] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:38:31 2022] GET /compute/v2.1/servers/e1f2a355-fc89-41b3-b51e-fe07af415279 => generated 1596 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:38:33.987953 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG dbcounter [-] [118476] Writing DB stats nova_cell0:SELECT=2 {{(pid=118476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:38:33.988899 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG dbcounter [-] [118476] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=3 {{(pid=118476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:38:33.993147 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [req-762c7f2d-124b-4b52-8a5e-c60090771be4 req-fc994f55-4f5d-4397-b3dd-43fb19d32134 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e1f2a355-fc89-41b3-b51e-fe07af415279", "tag": "5ea44cdb-5862-4ab0-96d6-265ecda6ad7a"}]} {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:38:34.003401 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [req-762c7f2d-124b-4b52-8a5e-c60090771be4 req-fc994f55-4f5d-4397-b3dd-43fb19d32134 service nova] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:38:34.004386 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [req-762c7f2d-124b-4b52-8a5e-c60090771be4 req-fc994f55-4f5d-4397-b3dd-43fb19d32134 service nova] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:38:34.008370 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG dbcounter [-] [118476] Writing DB stats nova_cell1:SELECT=82,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:38:34.016481 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.compute.server_external_events [req-762c7f2d-124b-4b52-8a5e-c60090771be4 req-fc994f55-4f5d-4397-b3dd-43fb19d32134 service nova] Creating event network-changed:5ea44cdb-5862-4ab0-96d6-265ecda6ad7a for instance e1f2a355-fc89-41b3-b51e-fe07af415279 on hv-cinder-85207 Aug 04 05:38:34.021904 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [req-762c7f2d-124b-4b52-8a5e-c60090771be4 req-fc994f55-4f5d-4397-b3dd-43fb19d32134 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035418 Aug 04 05:38:34.022594 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 527/1067] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Aug 4 05:38:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:38:36.263704 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-b6f18e7f-9fd7-41d0-aa59-6fc118b96ae8 tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1392150175"}} {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:38:36.264241 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-b6f18e7f-9fd7-41d0-aa59-6fc118b96ae8 tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] [instance: e1f2a355-fc89-41b3-b51e-fe07af415279] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:38:36.270788 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-b6f18e7f-9fd7-41d0-aa59-6fc118b96ae8 tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:38:36.271240 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-b6f18e7f-9fd7-41d0-aa59-6fc118b96ae8 tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:38:36.272002 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-b6f18e7f-9fd7-41d0-aa59-6fc118b96ae8 tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:38:36.272441 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-b6f18e7f-9fd7-41d0-aa59-6fc118b96ae8 tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:38:36.398293 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.network.security_group_api [None req-b6f18e7f-9fd7-41d0-aa59-6fc118b96ae8 tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] Adding security group eed3a355-d83c-4ac4-a5e1-5a97e7e660df to port 5ea44cdb-5862-4ab0-96d6-265ecda6ad7a Aug 04 05:38:36.770584 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-b6f18e7f-9fd7-41d0-aa59-6fc118b96ae8 tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] 10.222.0.46 "POST /compute/v2.1/servers/e1f2a355-fc89-41b3-b51e-fe07af415279/action" status: 202 len: 0 microversion: 2.1 time: 0.511543 Aug 04 05:38:36.771221 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 541/1068] 10.222.0.46 () {60 vars in 1278 bytes} [Thu Aug 4 05:38:36 2022] POST /compute/v2.1/servers/e1f2a355-fc89-41b3-b51e-fe07af415279/action => generated 0 bytes in 513 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 05:38:36.780531 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-3b3296a3-68c9-4431-b794-ff3a6f2c4e27 tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:38:36.781148 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-3b3296a3-68c9-4431-b794-ff3a6f2c4e27 tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] [instance: e1f2a355-fc89-41b3-b51e-fe07af415279] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:38:36.782027 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [req-aca8fe28-b9c5-48fb-95d0-1785e7a745bf req-0c78bea2-33ae-4d26-8044-06d11cac6c1f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e1f2a355-fc89-41b3-b51e-fe07af415279", "tag": "5ea44cdb-5862-4ab0-96d6-265ecda6ad7a"}]} {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:38:36.787483 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-3b3296a3-68c9-4431-b794-ff3a6f2c4e27 tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:38:36.787932 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-3b3296a3-68c9-4431-b794-ff3a6f2c4e27 tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:38:36.788706 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-3b3296a3-68c9-4431-b794-ff3a6f2c4e27 tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:38:36.789136 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-3b3296a3-68c9-4431-b794-ff3a6f2c4e27 tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:38:36.793585 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [req-aca8fe28-b9c5-48fb-95d0-1785e7a745bf req-0c78bea2-33ae-4d26-8044-06d11cac6c1f service nova] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:38:36.794219 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [req-aca8fe28-b9c5-48fb-95d0-1785e7a745bf req-0c78bea2-33ae-4d26-8044-06d11cac6c1f service nova] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:38:36.806250 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.compute.server_external_events [req-aca8fe28-b9c5-48fb-95d0-1785e7a745bf req-0c78bea2-33ae-4d26-8044-06d11cac6c1f service nova] Creating event network-changed:5ea44cdb-5862-4ab0-96d6-265ecda6ad7a for instance e1f2a355-fc89-41b3-b51e-fe07af415279 on hv-cinder-85207 Aug 04 05:38:36.815568 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [req-aca8fe28-b9c5-48fb-95d0-1785e7a745bf req-0c78bea2-33ae-4d26-8044-06d11cac6c1f service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036179 Aug 04 05:38:36.815568 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 528/1069] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Aug 4 05:38:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 05:38:36.993516 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-3b3296a3-68c9-4431-b794-ff3a6f2c4e27 tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ff7be84ccd459cb7159bcffc1de249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ee5ac3fb644e24973f40ede2c94de7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:38:37.004504 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-3b3296a3-68c9-4431-b794-ff3a6f2c4e27 tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] 10.222.0.46 "GET /compute/v2.1/servers/e1f2a355-fc89-41b3-b51e-fe07af415279" status: 200 len: 1761 microversion: 2.1 time: 0.228353 Aug 04 05:38:37.018337 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 542/1070] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:38:36 2022] GET /compute/v2.1/servers/e1f2a355-fc89-41b3-b51e-fe07af415279 => generated 1761 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:38:52.035585 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-f2d6e1f2-e2f5-4e65-8cc1-ddade8116922 tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:38:52.037860 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-f2d6e1f2-e2f5-4e65-8cc1-ddade8116922 tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] [instance: e1f2a355-fc89-41b3-b51e-fe07af415279] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:38:52.046339 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-f2d6e1f2-e2f5-4e65-8cc1-ddade8116922 tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:38:52.046788 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-f2d6e1f2-e2f5-4e65-8cc1-ddade8116922 tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:38:52.047575 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-f2d6e1f2-e2f5-4e65-8cc1-ddade8116922 tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:38:52.048007 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-f2d6e1f2-e2f5-4e65-8cc1-ddade8116922 tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:38:52.245855 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-f2d6e1f2-e2f5-4e65-8cc1-ddade8116922 tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] 10.222.0.46 "POST /compute/v2.1/servers/e1f2a355-fc89-41b3-b51e-fe07af415279/action" status: 202 len: 0 microversion: 2.1 time: 0.214704 Aug 04 05:38:52.246668 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 529/1071] 10.222.0.46 () {60 vars in 1278 bytes} [Thu Aug 4 05:38:52 2022] POST /compute/v2.1/servers/e1f2a355-fc89-41b3-b51e-fe07af415279/action => generated 0 bytes in 217 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 05:38:52.254867 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-7cfcdf87-50de-4975-a16a-f0ce683c859f tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:38:52.255551 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-7cfcdf87-50de-4975-a16a-f0ce683c859f tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] [instance: e1f2a355-fc89-41b3-b51e-fe07af415279] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:38:52.257998 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG dbcounter [-] [118477] Writing DB stats nova_api:SELECT=6 {{(pid=118477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:38:52.258679 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG dbcounter [-] [118477] Writing DB stats nova_cell1:SELECT=16 {{(pid=118477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:38:52.264008 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-7cfcdf87-50de-4975-a16a-f0ce683c859f tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:38:52.264456 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-7cfcdf87-50de-4975-a16a-f0ce683c859f tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:38:52.265252 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-7cfcdf87-50de-4975-a16a-f0ce683c859f tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:38:52.265687 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-7cfcdf87-50de-4975-a16a-f0ce683c859f tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:38:52.413161 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-7cfcdf87-50de-4975-a16a-f0ce683c859f tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ff7be84ccd459cb7159bcffc1de249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ee5ac3fb644e24973f40ede2c94de7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:38:52.421465 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-7cfcdf87-50de-4975-a16a-f0ce683c859f tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] 10.222.0.46 "GET /compute/v2.1/servers/e1f2a355-fc89-41b3-b51e-fe07af415279" status: 200 len: 1753 microversion: 2.1 time: 0.170559 Aug 04 05:38:52.422073 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 543/1072] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:38:52 2022] GET /compute/v2.1/servers/e1f2a355-fc89-41b3-b51e-fe07af415279 => generated 1753 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:38:53.444308 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-e96de8d5-3550-489e-9342-902febb289c9 tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:38:53.445105 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-e96de8d5-3550-489e-9342-902febb289c9 tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] [instance: e1f2a355-fc89-41b3-b51e-fe07af415279] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:38:53.451362 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-e96de8d5-3550-489e-9342-902febb289c9 tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:38:53.452397 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-e96de8d5-3550-489e-9342-902febb289c9 tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:38:53.453175 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-e96de8d5-3550-489e-9342-902febb289c9 tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:38:53.453599 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-e96de8d5-3550-489e-9342-902febb289c9 tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:38:53.599848 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-e96de8d5-3550-489e-9342-902febb289c9 tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ff7be84ccd459cb7159bcffc1de249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ee5ac3fb644e24973f40ede2c94de7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:38:53.608359 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-e96de8d5-3550-489e-9342-902febb289c9 tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] 10.222.0.46 "GET /compute/v2.1/servers/e1f2a355-fc89-41b3-b51e-fe07af415279" status: 200 len: 1758 microversion: 2.1 time: 0.168861 Aug 04 05:38:53.608920 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 530/1073] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:38:53 2022] GET /compute/v2.1/servers/e1f2a355-fc89-41b3-b51e-fe07af415279 => generated 1758 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:38:54.629331 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-9115832b-3ce0-42c2-ab38-9286019c5118 tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:38:54.629935 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-9115832b-3ce0-42c2-ab38-9286019c5118 tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] [instance: e1f2a355-fc89-41b3-b51e-fe07af415279] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:38:54.636376 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-9115832b-3ce0-42c2-ab38-9286019c5118 tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:38:54.636814 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-9115832b-3ce0-42c2-ab38-9286019c5118 tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:38:54.637560 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-9115832b-3ce0-42c2-ab38-9286019c5118 tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:38:54.637989 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-9115832b-3ce0-42c2-ab38-9286019c5118 tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:38:54.780567 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-9115832b-3ce0-42c2-ab38-9286019c5118 tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ff7be84ccd459cb7159bcffc1de249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ee5ac3fb644e24973f40ede2c94de7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:38:54.788788 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-9115832b-3ce0-42c2-ab38-9286019c5118 tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] 10.222.0.46 "GET /compute/v2.1/servers/e1f2a355-fc89-41b3-b51e-fe07af415279" status: 200 len: 1758 microversion: 2.1 time: 0.163204 Aug 04 05:38:54.789661 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 544/1074] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:38:54 2022] GET /compute/v2.1/servers/e1f2a355-fc89-41b3-b51e-fe07af415279 => generated 1758 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:38:55.811293 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-a47f6b4f-710a-4c44-8ff7-3faa1eda49fc tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:38:55.811979 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-a47f6b4f-710a-4c44-8ff7-3faa1eda49fc tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] [instance: e1f2a355-fc89-41b3-b51e-fe07af415279] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:38:55.818450 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-a47f6b4f-710a-4c44-8ff7-3faa1eda49fc tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:38:55.818889 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-a47f6b4f-710a-4c44-8ff7-3faa1eda49fc tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:38:55.819631 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-a47f6b4f-710a-4c44-8ff7-3faa1eda49fc tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:38:55.820058 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-a47f6b4f-710a-4c44-8ff7-3faa1eda49fc tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:38:55.969977 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-a47f6b4f-710a-4c44-8ff7-3faa1eda49fc tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ff7be84ccd459cb7159bcffc1de249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ee5ac3fb644e24973f40ede2c94de7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:38:55.977887 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-a47f6b4f-710a-4c44-8ff7-3faa1eda49fc tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] 10.222.0.46 "GET /compute/v2.1/servers/e1f2a355-fc89-41b3-b51e-fe07af415279" status: 200 len: 1758 microversion: 2.1 time: 0.170484 Aug 04 05:38:55.978738 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 531/1075] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:38:55 2022] GET /compute/v2.1/servers/e1f2a355-fc89-41b3-b51e-fe07af415279 => generated 1758 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:38:56.999715 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-7b1708fa-fa87-478f-941f-6ba421517df8 tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:38:57.000244 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-7b1708fa-fa87-478f-941f-6ba421517df8 tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] [instance: e1f2a355-fc89-41b3-b51e-fe07af415279] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:38:57.006408 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-7b1708fa-fa87-478f-941f-6ba421517df8 tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:38:57.006853 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-7b1708fa-fa87-478f-941f-6ba421517df8 tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:38:57.007606 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-7b1708fa-fa87-478f-941f-6ba421517df8 tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:38:57.008037 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-7b1708fa-fa87-478f-941f-6ba421517df8 tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:38:57.147372 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-7b1708fa-fa87-478f-941f-6ba421517df8 tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ff7be84ccd459cb7159bcffc1de249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ee5ac3fb644e24973f40ede2c94de7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:38:57.156430 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-7b1708fa-fa87-478f-941f-6ba421517df8 tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] 10.222.0.46 "GET /compute/v2.1/servers/e1f2a355-fc89-41b3-b51e-fe07af415279" status: 200 len: 1758 microversion: 2.1 time: 0.160675 Aug 04 05:38:57.157001 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 545/1076] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:38:56 2022] GET /compute/v2.1/servers/e1f2a355-fc89-41b3-b51e-fe07af415279 => generated 1758 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:38:58.177017 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-bdb51412-c7fd-42df-bd6f-d372cd590cd4 tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:38:58.177620 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-bdb51412-c7fd-42df-bd6f-d372cd590cd4 tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] [instance: e1f2a355-fc89-41b3-b51e-fe07af415279] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:38:58.184165 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-bdb51412-c7fd-42df-bd6f-d372cd590cd4 tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:38:58.184614 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-bdb51412-c7fd-42df-bd6f-d372cd590cd4 tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:38:58.185371 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-bdb51412-c7fd-42df-bd6f-d372cd590cd4 tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:38:58.185801 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-bdb51412-c7fd-42df-bd6f-d372cd590cd4 tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:38:58.335678 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-bdb51412-c7fd-42df-bd6f-d372cd590cd4 tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ff7be84ccd459cb7159bcffc1de249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ee5ac3fb644e24973f40ede2c94de7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:38:58.343673 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-bdb51412-c7fd-42df-bd6f-d372cd590cd4 tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] 10.222.0.46 "GET /compute/v2.1/servers/e1f2a355-fc89-41b3-b51e-fe07af415279" status: 200 len: 1758 microversion: 2.1 time: 0.170517 Aug 04 05:38:58.344246 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 532/1077] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:38:58 2022] GET /compute/v2.1/servers/e1f2a355-fc89-41b3-b51e-fe07af415279 => generated 1758 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:38:59.365354 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-b733d49c-ab52-4047-8fb9-1c18a434ab55 tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:38:59.365972 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-b733d49c-ab52-4047-8fb9-1c18a434ab55 tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] [instance: e1f2a355-fc89-41b3-b51e-fe07af415279] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:38:59.372422 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-b733d49c-ab52-4047-8fb9-1c18a434ab55 tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:38:59.372873 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-b733d49c-ab52-4047-8fb9-1c18a434ab55 tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:38:59.373635 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-b733d49c-ab52-4047-8fb9-1c18a434ab55 tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:38:59.374077 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-b733d49c-ab52-4047-8fb9-1c18a434ab55 tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:38:59.520763 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-b733d49c-ab52-4047-8fb9-1c18a434ab55 tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ff7be84ccd459cb7159bcffc1de249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ee5ac3fb644e24973f40ede2c94de7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:38:59.529293 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-b733d49c-ab52-4047-8fb9-1c18a434ab55 tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] 10.222.0.46 "GET /compute/v2.1/servers/e1f2a355-fc89-41b3-b51e-fe07af415279" status: 200 len: 1758 microversion: 2.1 time: 0.167713 Aug 04 05:38:59.529869 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 546/1078] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:38:59 2022] GET /compute/v2.1/servers/e1f2a355-fc89-41b3-b51e-fe07af415279 => generated 1758 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:39:00.552047 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-9878e7bd-0ff1-44c5-9a9d-46e887e7e44e tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:39:00.552708 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-9878e7bd-0ff1-44c5-9a9d-46e887e7e44e tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] [instance: e1f2a355-fc89-41b3-b51e-fe07af415279] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:39:00.559167 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-9878e7bd-0ff1-44c5-9a9d-46e887e7e44e tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:39:00.559610 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-9878e7bd-0ff1-44c5-9a9d-46e887e7e44e tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:39:00.560365 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-9878e7bd-0ff1-44c5-9a9d-46e887e7e44e tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:39:00.560799 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-9878e7bd-0ff1-44c5-9a9d-46e887e7e44e tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:39:00.704038 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-9878e7bd-0ff1-44c5-9a9d-46e887e7e44e tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ff7be84ccd459cb7159bcffc1de249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ee5ac3fb644e24973f40ede2c94de7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:39:00.711906 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-9878e7bd-0ff1-44c5-9a9d-46e887e7e44e tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] 10.222.0.46 "GET /compute/v2.1/servers/e1f2a355-fc89-41b3-b51e-fe07af415279" status: 200 len: 1758 microversion: 2.1 time: 0.163878 Aug 04 05:39:00.712478 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 533/1079] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:39:00 2022] GET /compute/v2.1/servers/e1f2a355-fc89-41b3-b51e-fe07af415279 => generated 1758 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:39:01.733677 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-e711b31f-13ed-4054-ac9b-06a70f1dd0ed tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:39:01.734593 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-e711b31f-13ed-4054-ac9b-06a70f1dd0ed tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] [instance: e1f2a355-fc89-41b3-b51e-fe07af415279] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:39:01.741000 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-e711b31f-13ed-4054-ac9b-06a70f1dd0ed tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:39:01.742542 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-e711b31f-13ed-4054-ac9b-06a70f1dd0ed tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:39:01.742542 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-e711b31f-13ed-4054-ac9b-06a70f1dd0ed tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:39:01.742834 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-e711b31f-13ed-4054-ac9b-06a70f1dd0ed tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:39:01.887449 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-e711b31f-13ed-4054-ac9b-06a70f1dd0ed tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ff7be84ccd459cb7159bcffc1de249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ee5ac3fb644e24973f40ede2c94de7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:39:01.895564 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-e711b31f-13ed-4054-ac9b-06a70f1dd0ed tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] 10.222.0.46 "GET /compute/v2.1/servers/e1f2a355-fc89-41b3-b51e-fe07af415279" status: 200 len: 1758 microversion: 2.1 time: 0.166286 Aug 04 05:39:01.896152 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 547/1080] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:39:01 2022] GET /compute/v2.1/servers/e1f2a355-fc89-41b3-b51e-fe07af415279 => generated 1758 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:39:02.917009 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-2c3b8d01-72dd-49e2-93c9-c480092d547e tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:39:02.917634 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-2c3b8d01-72dd-49e2-93c9-c480092d547e tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] [instance: e1f2a355-fc89-41b3-b51e-fe07af415279] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:39:02.924561 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-2c3b8d01-72dd-49e2-93c9-c480092d547e tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:39:02.925007 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-2c3b8d01-72dd-49e2-93c9-c480092d547e tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:39:02.925771 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-2c3b8d01-72dd-49e2-93c9-c480092d547e tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:39:02.926207 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-2c3b8d01-72dd-49e2-93c9-c480092d547e tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:39:03.077760 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-2c3b8d01-72dd-49e2-93c9-c480092d547e tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ff7be84ccd459cb7159bcffc1de249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ee5ac3fb644e24973f40ede2c94de7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:39:03.085958 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-2c3b8d01-72dd-49e2-93c9-c480092d547e tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] 10.222.0.46 "GET /compute/v2.1/servers/e1f2a355-fc89-41b3-b51e-fe07af415279" status: 200 len: 1758 microversion: 2.1 time: 0.172718 Aug 04 05:39:03.086581 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 534/1081] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:39:02 2022] GET /compute/v2.1/servers/e1f2a355-fc89-41b3-b51e-fe07af415279 => generated 1758 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:39:03.145423 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-f5651307-574a-47f9-a904-b2844de06b10 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1030764908", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1497229411", "security_groups": [{"name": "tempest-secgroup-smoke-457367990"}], "block_device_mapping_v2": [{"uuid": "449c8d5d-b782-4af8-9bd1-2fef71c06f9c", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "999bb983-d3f9-4c98-9b4a-52666f821973"}]}} {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:39:03.258580 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.network.neutron [None req-f5651307-574a-47f9-a904-b2844de06b10 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] validate_networks() for [('999bb983-d3f9-4c98-9b4a-52666f821973', None, None, None, None, None)] {{(pid=118477) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 05:39:03.675109 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.virt.hardware [None req-f5651307-574a-47f9-a904-b2844de06b10 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Flavor limits 0:0:0 {{(pid=118477) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 05:39:03.678170 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.virt.hardware [None req-f5651307-574a-47f9-a904-b2844de06b10 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Image limits 0:0:0 {{(pid=118477) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 05:39:03.678170 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.virt.hardware [None req-f5651307-574a-47f9-a904-b2844de06b10 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Flavor pref 0:0:0 {{(pid=118477) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 05:39:03.678170 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.virt.hardware [None req-f5651307-574a-47f9-a904-b2844de06b10 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Image pref 0:0:0 {{(pid=118477) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 05:39:03.678170 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.virt.hardware [None req-f5651307-574a-47f9-a904-b2844de06b10 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118477) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 05:39:03.685815 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-f5651307-574a-47f9-a904-b2844de06b10 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:39:03.686783 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-f5651307-574a-47f9-a904-b2844de06b10 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:39:03.688167 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-f5651307-574a-47f9-a904-b2844de06b10 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:39:03.688597 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-f5651307-574a-47f9-a904-b2844de06b10 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:39:03.705749 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.quota [None req-f5651307-574a-47f9-a904-b2844de06b10 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Getting quotas for project c37bea771e9a4c26a19ff2ea9ed9d9b4. Resources: {'instances', 'cores', 'ram'} {{(pid=118477) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 05:39:03.709527 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.quota [None req-f5651307-574a-47f9-a904-b2844de06b10 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Getting quotas for user 5ffe04946139486bb4b976cb0503e0aa and project c37bea771e9a4c26a19ff2ea9ed9d9b4. Resources: {'instances', 'cores', 'ram'} {{(pid=118477) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 05:39:03.766220 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-f5651307-574a-47f9-a904-b2844de06b10 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Going to run 1 instances... {{(pid=118477) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 05:39:03.768308 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-f5651307-574a-47f9-a904-b2844de06b10 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] [instance: b9957ec5-1fe1-4a2d-9fdc-dbfa8e3eb9da] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='449c8d5d-b782-4af8-9bd1-2fef71c06f9c',volume_size=None,volume_type=None)] {{(pid=118477) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 05:39:04.101251 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-f5651307-574a-47f9-a904-b2844de06b10 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.959841 Aug 04 05:39:04.102080 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 548/1082] 10.222.0.46 () {60 vars in 1147 bytes} [Thu Aug 4 05:39:03 2022] POST /compute/v2.1/servers => generated 405 bytes in 961 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 05:39:04.107952 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-4a9cd9a3-a072-4208-bb79-3bf8d39bc58b tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:39:04.109430 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-4a9cd9a3-a072-4208-bb79-3bf8d39bc58b tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] [instance: e1f2a355-fc89-41b3-b51e-fe07af415279] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:39:04.113777 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-14132d8a-9a8d-4fb2-8357-3044f6a64bce tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:39:04.114501 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-14132d8a-9a8d-4fb2-8357-3044f6a64bce tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] [instance: b9957ec5-1fe1-4a2d-9fdc-dbfa8e3eb9da] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:39:04.116570 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-4a9cd9a3-a072-4208-bb79-3bf8d39bc58b tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:39:04.117229 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-4a9cd9a3-a072-4208-bb79-3bf8d39bc58b tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:39:04.118010 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-4a9cd9a3-a072-4208-bb79-3bf8d39bc58b tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:39:04.118647 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-4a9cd9a3-a072-4208-bb79-3bf8d39bc58b tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:39:04.182492 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-14132d8a-9a8d-4fb2-8357-3044f6a64bce tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ffe04946139486bb4b976cb0503e0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c37bea771e9a4c26a19ff2ea9ed9d9b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:39:04.189881 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-14132d8a-9a8d-4fb2-8357-3044f6a64bce tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] 10.222.0.46 "GET /compute/v2.1/servers/b9957ec5-1fe1-4a2d-9fdc-dbfa8e3eb9da" status: 200 len: 1095 microversion: 2.1 time: 0.079806 Aug 04 05:39:04.190591 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 549/1083] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:39:04 2022] GET /compute/v2.1/servers/b9957ec5-1fe1-4a2d-9fdc-dbfa8e3eb9da => generated 1095 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 05:39:04.288509 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-4a9cd9a3-a072-4208-bb79-3bf8d39bc58b tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ff7be84ccd459cb7159bcffc1de249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ee5ac3fb644e24973f40ede2c94de7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:39:04.296747 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-4a9cd9a3-a072-4208-bb79-3bf8d39bc58b tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] 10.222.0.46 "GET /compute/v2.1/servers/e1f2a355-fc89-41b3-b51e-fe07af415279" status: 200 len: 1758 microversion: 2.1 time: 0.192846 Aug 04 05:39:04.300482 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 535/1084] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:39:04 2022] GET /compute/v2.1/servers/e1f2a355-fc89-41b3-b51e-fe07af415279 => generated 1758 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:39:05.211899 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-bc22987e-5915-4b6e-8bab-2e8ea0b91a03 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:39:05.212557 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-bc22987e-5915-4b6e-8bab-2e8ea0b91a03 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] [instance: b9957ec5-1fe1-4a2d-9fdc-dbfa8e3eb9da] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:39:05.219758 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-bc22987e-5915-4b6e-8bab-2e8ea0b91a03 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:39:05.220198 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-bc22987e-5915-4b6e-8bab-2e8ea0b91a03 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:39:05.220973 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-bc22987e-5915-4b6e-8bab-2e8ea0b91a03 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:39:05.221385 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-bc22987e-5915-4b6e-8bab-2e8ea0b91a03 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:39:05.286398 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-bc22987e-5915-4b6e-8bab-2e8ea0b91a03 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ffe04946139486bb4b976cb0503e0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c37bea771e9a4c26a19ff2ea9ed9d9b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:39:05.293693 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-bc22987e-5915-4b6e-8bab-2e8ea0b91a03 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] 10.222.0.46 "GET /compute/v2.1/servers/b9957ec5-1fe1-4a2d-9fdc-dbfa8e3eb9da" status: 200 len: 1145 microversion: 2.1 time: 0.085825 Aug 04 05:39:05.294408 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 550/1085] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:39:05 2022] GET /compute/v2.1/servers/b9957ec5-1fe1-4a2d-9fdc-dbfa8e3eb9da => generated 1145 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:39:05.320667 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-b97abc85-1755-40bf-8d7b-3b5cca21edbb tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:39:05.321278 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-b97abc85-1755-40bf-8d7b-3b5cca21edbb tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] [instance: e1f2a355-fc89-41b3-b51e-fe07af415279] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:39:05.327508 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-b97abc85-1755-40bf-8d7b-3b5cca21edbb tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:39:05.327958 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-b97abc85-1755-40bf-8d7b-3b5cca21edbb tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:39:05.329952 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-b97abc85-1755-40bf-8d7b-3b5cca21edbb tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:39:05.329952 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-b97abc85-1755-40bf-8d7b-3b5cca21edbb tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:39:05.475954 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-b97abc85-1755-40bf-8d7b-3b5cca21edbb tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ff7be84ccd459cb7159bcffc1de249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ee5ac3fb644e24973f40ede2c94de7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:39:05.483943 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-b97abc85-1755-40bf-8d7b-3b5cca21edbb tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] 10.222.0.46 "GET /compute/v2.1/servers/e1f2a355-fc89-41b3-b51e-fe07af415279" status: 200 len: 1761 microversion: 2.1 time: 0.167206 Aug 04 05:39:05.484517 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 536/1086] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:39:05 2022] GET /compute/v2.1/servers/e1f2a355-fc89-41b3-b51e-fe07af415279 => generated 1761 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:39:06.314403 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-6a339b95-a029-453a-96f2-402b9bb1d3f6 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:39:06.315018 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-6a339b95-a029-453a-96f2-402b9bb1d3f6 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] [instance: b9957ec5-1fe1-4a2d-9fdc-dbfa8e3eb9da] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:39:06.321674 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-6a339b95-a029-453a-96f2-402b9bb1d3f6 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:39:06.322243 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-6a339b95-a029-453a-96f2-402b9bb1d3f6 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:39:06.323050 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-6a339b95-a029-453a-96f2-402b9bb1d3f6 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:39:06.323490 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-6a339b95-a029-453a-96f2-402b9bb1d3f6 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:39:06.396863 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-6a339b95-a029-453a-96f2-402b9bb1d3f6 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ffe04946139486bb4b976cb0503e0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c37bea771e9a4c26a19ff2ea9ed9d9b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:39:06.404709 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-6a339b95-a029-453a-96f2-402b9bb1d3f6 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] 10.222.0.46 "GET /compute/v2.1/servers/b9957ec5-1fe1-4a2d-9fdc-dbfa8e3eb9da" status: 200 len: 1201 microversion: 2.1 time: 0.094192 Aug 04 05:39:06.406904 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 551/1087] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:39:06 2022] GET /compute/v2.1/servers/b9957ec5-1fe1-4a2d-9fdc-dbfa8e3eb9da => generated 1201 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:39:07.428556 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-14c65136-90d0-4a20-a297-18036cab0115 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:39:07.430109 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-14c65136-90d0-4a20-a297-18036cab0115 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] [instance: b9957ec5-1fe1-4a2d-9fdc-dbfa8e3eb9da] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:39:07.437699 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-14c65136-90d0-4a20-a297-18036cab0115 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:39:07.438285 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-14c65136-90d0-4a20-a297-18036cab0115 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:39:07.440840 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-14c65136-90d0-4a20-a297-18036cab0115 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:39:07.441349 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-14c65136-90d0-4a20-a297-18036cab0115 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:39:07.667712 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-14c65136-90d0-4a20-a297-18036cab0115 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ffe04946139486bb4b976cb0503e0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c37bea771e9a4c26a19ff2ea9ed9d9b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:39:07.675872 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-14c65136-90d0-4a20-a297-18036cab0115 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] 10.222.0.46 "GET /compute/v2.1/servers/b9957ec5-1fe1-4a2d-9fdc-dbfa8e3eb9da" status: 200 len: 1278 microversion: 2.1 time: 0.251588 Aug 04 05:39:07.678830 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 537/1088] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:39:07 2022] GET /compute/v2.1/servers/b9957ec5-1fe1-4a2d-9fdc-dbfa8e3eb9da => generated 1278 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:39:08.100380 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [req-c68d5f2b-333d-40be-afdf-a14da2518ee7 req-c053d2f4-b336-4066-9c57-6a68717cd237 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b9957ec5-1fe1-4a2d-9fdc-dbfa8e3eb9da", "tag": "2f570185-d303-4660-8d4e-91485facbcf7"}]} {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:39:08.111370 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [req-c68d5f2b-333d-40be-afdf-a14da2518ee7 req-c053d2f4-b336-4066-9c57-6a68717cd237 service nova] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:39:08.111811 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [req-c68d5f2b-333d-40be-afdf-a14da2518ee7 req-c053d2f4-b336-4066-9c57-6a68717cd237 service nova] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:39:08.122834 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.compute.server_external_events [req-c68d5f2b-333d-40be-afdf-a14da2518ee7 req-c053d2f4-b336-4066-9c57-6a68717cd237 service nova] Creating event network-changed:2f570185-d303-4660-8d4e-91485facbcf7 for instance b9957ec5-1fe1-4a2d-9fdc-dbfa8e3eb9da on hv-cinder-85207 Aug 04 05:39:08.128925 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [req-c68d5f2b-333d-40be-afdf-a14da2518ee7 req-c053d2f4-b336-4066-9c57-6a68717cd237 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034509 Aug 04 05:39:08.129526 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 552/1089] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Aug 4 05:39:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 05:39:08.697336 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-cededd07-7310-4578-a2d4-2be0714f7503 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:39:08.698053 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-cededd07-7310-4578-a2d4-2be0714f7503 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] [instance: b9957ec5-1fe1-4a2d-9fdc-dbfa8e3eb9da] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:39:08.705076 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-cededd07-7310-4578-a2d4-2be0714f7503 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:39:08.705525 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-cededd07-7310-4578-a2d4-2be0714f7503 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:39:08.706299 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-cededd07-7310-4578-a2d4-2be0714f7503 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:39:08.706766 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-cededd07-7310-4578-a2d4-2be0714f7503 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:39:08.911071 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-cededd07-7310-4578-a2d4-2be0714f7503 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ffe04946139486bb4b976cb0503e0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c37bea771e9a4c26a19ff2ea9ed9d9b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:39:08.918524 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-cededd07-7310-4578-a2d4-2be0714f7503 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] 10.222.0.46 "GET /compute/v2.1/servers/b9957ec5-1fe1-4a2d-9fdc-dbfa8e3eb9da" status: 200 len: 1266 microversion: 2.1 time: 0.224984 Aug 04 05:39:08.919374 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 538/1090] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:39:08 2022] GET /compute/v2.1/servers/b9957ec5-1fe1-4a2d-9fdc-dbfa8e3eb9da => generated 1266 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:39:09.941290 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-cb1d64b5-33b5-4626-a9c7-c56157818440 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:39:09.941979 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-cb1d64b5-33b5-4626-a9c7-c56157818440 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] [instance: b9957ec5-1fe1-4a2d-9fdc-dbfa8e3eb9da] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:39:09.948667 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-cb1d64b5-33b5-4626-a9c7-c56157818440 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:39:09.949106 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-cb1d64b5-33b5-4626-a9c7-c56157818440 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:39:09.949849 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-cb1d64b5-33b5-4626-a9c7-c56157818440 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:39:09.950275 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-cb1d64b5-33b5-4626-a9c7-c56157818440 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:39:10.080085 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-cb1d64b5-33b5-4626-a9c7-c56157818440 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ffe04946139486bb4b976cb0503e0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c37bea771e9a4c26a19ff2ea9ed9d9b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:39:10.087624 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-cb1d64b5-33b5-4626-a9c7-c56157818440 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] 10.222.0.46 "GET /compute/v2.1/servers/b9957ec5-1fe1-4a2d-9fdc-dbfa8e3eb9da" status: 200 len: 1266 microversion: 2.1 time: 0.151540 Aug 04 05:39:10.088192 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 553/1091] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:39:09 2022] GET /compute/v2.1/servers/b9957ec5-1fe1-4a2d-9fdc-dbfa8e3eb9da => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:39:11.109296 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-26b8ef96-3286-4564-92f4-31e2875b7a9b tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:39:11.109932 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-26b8ef96-3286-4564-92f4-31e2875b7a9b tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] [instance: b9957ec5-1fe1-4a2d-9fdc-dbfa8e3eb9da] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:39:11.116341 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-26b8ef96-3286-4564-92f4-31e2875b7a9b tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:39:11.116805 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-26b8ef96-3286-4564-92f4-31e2875b7a9b tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:39:11.117548 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-26b8ef96-3286-4564-92f4-31e2875b7a9b tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:39:11.117985 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-26b8ef96-3286-4564-92f4-31e2875b7a9b tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:39:11.249598 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-26b8ef96-3286-4564-92f4-31e2875b7a9b tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ffe04946139486bb4b976cb0503e0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c37bea771e9a4c26a19ff2ea9ed9d9b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:39:11.257067 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-26b8ef96-3286-4564-92f4-31e2875b7a9b tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] 10.222.0.46 "GET /compute/v2.1/servers/b9957ec5-1fe1-4a2d-9fdc-dbfa8e3eb9da" status: 200 len: 1266 microversion: 2.1 time: 0.152315 Aug 04 05:39:11.257642 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 539/1092] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:39:11 2022] GET /compute/v2.1/servers/b9957ec5-1fe1-4a2d-9fdc-dbfa8e3eb9da => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:39:12.277961 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-cbbda329-c7ca-49c2-aeef-9cf9343f005c tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:39:12.278637 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-cbbda329-c7ca-49c2-aeef-9cf9343f005c tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] [instance: b9957ec5-1fe1-4a2d-9fdc-dbfa8e3eb9da] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:39:12.285767 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-cbbda329-c7ca-49c2-aeef-9cf9343f005c tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:39:12.286211 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-cbbda329-c7ca-49c2-aeef-9cf9343f005c tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:39:12.287002 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-cbbda329-c7ca-49c2-aeef-9cf9343f005c tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:39:12.287436 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-cbbda329-c7ca-49c2-aeef-9cf9343f005c tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:39:12.416751 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-cbbda329-c7ca-49c2-aeef-9cf9343f005c tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ffe04946139486bb4b976cb0503e0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c37bea771e9a4c26a19ff2ea9ed9d9b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:39:12.424515 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-cbbda329-c7ca-49c2-aeef-9cf9343f005c tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] 10.222.0.46 "GET /compute/v2.1/servers/b9957ec5-1fe1-4a2d-9fdc-dbfa8e3eb9da" status: 200 len: 1266 microversion: 2.1 time: 0.150548 Aug 04 05:39:12.425064 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 554/1093] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:39:12 2022] GET /compute/v2.1/servers/b9957ec5-1fe1-4a2d-9fdc-dbfa8e3eb9da => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:39:13.445788 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-2cb6c50e-2b56-4beb-b969-8c95f2d41bc4 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:39:13.446501 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-2cb6c50e-2b56-4beb-b969-8c95f2d41bc4 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] [instance: b9957ec5-1fe1-4a2d-9fdc-dbfa8e3eb9da] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:39:13.453771 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-2cb6c50e-2b56-4beb-b969-8c95f2d41bc4 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:39:13.454224 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-2cb6c50e-2b56-4beb-b969-8c95f2d41bc4 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:39:13.455016 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-2cb6c50e-2b56-4beb-b969-8c95f2d41bc4 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:39:13.455455 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-2cb6c50e-2b56-4beb-b969-8c95f2d41bc4 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:39:13.584186 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-2cb6c50e-2b56-4beb-b969-8c95f2d41bc4 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ffe04946139486bb4b976cb0503e0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c37bea771e9a4c26a19ff2ea9ed9d9b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:39:13.591613 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-2cb6c50e-2b56-4beb-b969-8c95f2d41bc4 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] 10.222.0.46 "GET /compute/v2.1/servers/b9957ec5-1fe1-4a2d-9fdc-dbfa8e3eb9da" status: 200 len: 1266 microversion: 2.1 time: 0.149689 Aug 04 05:39:13.592721 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 540/1094] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:39:13 2022] GET /compute/v2.1/servers/b9957ec5-1fe1-4a2d-9fdc-dbfa8e3eb9da => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:39:14.613231 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-fa44ef9a-fe01-4424-bf17-6430faa7c810 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:39:14.613771 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-fa44ef9a-fe01-4424-bf17-6430faa7c810 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] [instance: b9957ec5-1fe1-4a2d-9fdc-dbfa8e3eb9da] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:39:14.617307 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG dbcounter [-] [118477] Writing DB stats nova_cell0:SELECT=2 {{(pid=118477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:39:14.617997 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG dbcounter [-] [118477] Writing DB stats nova_cell0:SELECT=8 {{(pid=118477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:39:14.621659 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-fa44ef9a-fe01-4424-bf17-6430faa7c810 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:39:14.622108 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-fa44ef9a-fe01-4424-bf17-6430faa7c810 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:39:14.622914 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-fa44ef9a-fe01-4424-bf17-6430faa7c810 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:39:14.623352 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-fa44ef9a-fe01-4424-bf17-6430faa7c810 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:39:14.761029 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-fa44ef9a-fe01-4424-bf17-6430faa7c810 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ffe04946139486bb4b976cb0503e0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c37bea771e9a4c26a19ff2ea9ed9d9b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:39:14.768725 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-fa44ef9a-fe01-4424-bf17-6430faa7c810 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] 10.222.0.46 "GET /compute/v2.1/servers/b9957ec5-1fe1-4a2d-9fdc-dbfa8e3eb9da" status: 200 len: 1266 microversion: 2.1 time: 0.159492 Aug 04 05:39:14.769297 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 555/1095] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:39:14 2022] GET /compute/v2.1/servers/b9957ec5-1fe1-4a2d-9fdc-dbfa8e3eb9da => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:39:15.790301 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-ce373cb9-b3bf-4840-a800-43532f0d581b tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:39:15.790876 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-ce373cb9-b3bf-4840-a800-43532f0d581b tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] [instance: b9957ec5-1fe1-4a2d-9fdc-dbfa8e3eb9da] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:39:15.798059 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-ce373cb9-b3bf-4840-a800-43532f0d581b tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:39:15.798545 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-ce373cb9-b3bf-4840-a800-43532f0d581b tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:39:15.799305 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-ce373cb9-b3bf-4840-a800-43532f0d581b tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:39:15.799740 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-ce373cb9-b3bf-4840-a800-43532f0d581b tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:39:15.928848 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-ce373cb9-b3bf-4840-a800-43532f0d581b tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ffe04946139486bb4b976cb0503e0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c37bea771e9a4c26a19ff2ea9ed9d9b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:39:15.936187 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-ce373cb9-b3bf-4840-a800-43532f0d581b tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] 10.222.0.46 "GET /compute/v2.1/servers/b9957ec5-1fe1-4a2d-9fdc-dbfa8e3eb9da" status: 200 len: 1266 microversion: 2.1 time: 0.149776 Aug 04 05:39:15.936765 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 541/1096] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:39:15 2022] GET /compute/v2.1/servers/b9957ec5-1fe1-4a2d-9fdc-dbfa8e3eb9da => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:39:16.956973 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-d2ab6e39-9a03-481e-97e3-d27ce0484834 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:39:16.957702 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-d2ab6e39-9a03-481e-97e3-d27ce0484834 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] [instance: b9957ec5-1fe1-4a2d-9fdc-dbfa8e3eb9da] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:39:16.967916 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-d2ab6e39-9a03-481e-97e3-d27ce0484834 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:39:16.968365 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-d2ab6e39-9a03-481e-97e3-d27ce0484834 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:39:16.969186 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-d2ab6e39-9a03-481e-97e3-d27ce0484834 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:39:16.969618 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-d2ab6e39-9a03-481e-97e3-d27ce0484834 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:39:17.112704 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-d2ab6e39-9a03-481e-97e3-d27ce0484834 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ffe04946139486bb4b976cb0503e0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c37bea771e9a4c26a19ff2ea9ed9d9b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:39:17.120224 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-d2ab6e39-9a03-481e-97e3-d27ce0484834 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] 10.222.0.46 "GET /compute/v2.1/servers/b9957ec5-1fe1-4a2d-9fdc-dbfa8e3eb9da" status: 200 len: 1266 microversion: 2.1 time: 0.167074 Aug 04 05:39:17.120795 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 556/1097] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:39:16 2022] GET /compute/v2.1/servers/b9957ec5-1fe1-4a2d-9fdc-dbfa8e3eb9da => generated 1266 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:39:18.141414 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-a1993836-6297-46cc-8945-31f6d5d786d4 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:39:18.142014 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-a1993836-6297-46cc-8945-31f6d5d786d4 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] [instance: b9957ec5-1fe1-4a2d-9fdc-dbfa8e3eb9da] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:39:18.148409 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-a1993836-6297-46cc-8945-31f6d5d786d4 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:39:18.149115 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-a1993836-6297-46cc-8945-31f6d5d786d4 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:39:18.149862 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-a1993836-6297-46cc-8945-31f6d5d786d4 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:39:18.150288 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-a1993836-6297-46cc-8945-31f6d5d786d4 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:39:18.280721 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-a1993836-6297-46cc-8945-31f6d5d786d4 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ffe04946139486bb4b976cb0503e0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c37bea771e9a4c26a19ff2ea9ed9d9b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:39:18.288109 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-a1993836-6297-46cc-8945-31f6d5d786d4 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] 10.222.0.46 "GET /compute/v2.1/servers/b9957ec5-1fe1-4a2d-9fdc-dbfa8e3eb9da" status: 200 len: 1266 microversion: 2.1 time: 0.150654 Aug 04 05:39:18.288668 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 542/1098] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:39:18 2022] GET /compute/v2.1/servers/b9957ec5-1fe1-4a2d-9fdc-dbfa8e3eb9da => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:39:18.602623 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [req-26818e6e-6493-40ae-bf27-ed6c14fe053b req-095cdac3-cbbd-4d39-9956-12b13e4926fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9957ec5-1fe1-4a2d-9fdc-dbfa8e3eb9da", "name": "network-vif-plugged", "status": "completed", "tag": "2f570185-d303-4660-8d4e-91485facbcf7"}]} {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:39:18.613200 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [req-26818e6e-6493-40ae-bf27-ed6c14fe053b req-095cdac3-cbbd-4d39-9956-12b13e4926fb service nova] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:39:18.613644 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [req-26818e6e-6493-40ae-bf27-ed6c14fe053b req-095cdac3-cbbd-4d39-9956-12b13e4926fb service nova] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:39:18.624454 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.compute.server_external_events [req-26818e6e-6493-40ae-bf27-ed6c14fe053b req-095cdac3-cbbd-4d39-9956-12b13e4926fb service nova] Creating event network-vif-plugged:2f570185-d303-4660-8d4e-91485facbcf7 for instance b9957ec5-1fe1-4a2d-9fdc-dbfa8e3eb9da on hv-cinder-85207 Aug 04 05:39:18.629532 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [req-26818e6e-6493-40ae-bf27-ed6c14fe053b req-095cdac3-cbbd-4d39-9956-12b13e4926fb service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030986 Aug 04 05:39:18.630151 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 557/1099] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Aug 4 05:39:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:39:19.309038 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-070cffde-b06f-4394-b42f-74ef7fc7c082 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:39:19.309641 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-070cffde-b06f-4394-b42f-74ef7fc7c082 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] [instance: b9957ec5-1fe1-4a2d-9fdc-dbfa8e3eb9da] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:39:19.316949 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-070cffde-b06f-4394-b42f-74ef7fc7c082 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:39:19.317392 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-070cffde-b06f-4394-b42f-74ef7fc7c082 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:39:19.318139 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-070cffde-b06f-4394-b42f-74ef7fc7c082 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:39:19.318615 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-070cffde-b06f-4394-b42f-74ef7fc7c082 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:39:19.446931 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-070cffde-b06f-4394-b42f-74ef7fc7c082 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ffe04946139486bb4b976cb0503e0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c37bea771e9a4c26a19ff2ea9ed9d9b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:39:19.454569 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-070cffde-b06f-4394-b42f-74ef7fc7c082 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] 10.222.0.46 "GET /compute/v2.1/servers/b9957ec5-1fe1-4a2d-9fdc-dbfa8e3eb9da" status: 200 len: 1266 microversion: 2.1 time: 0.149448 Aug 04 05:39:19.455139 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 543/1100] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:39:19 2022] GET /compute/v2.1/servers/b9957ec5-1fe1-4a2d-9fdc-dbfa8e3eb9da => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:39:20.480798 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-04cc3994-f70c-4502-a7af-f2fb45677079 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:39:20.481409 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-04cc3994-f70c-4502-a7af-f2fb45677079 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] [instance: b9957ec5-1fe1-4a2d-9fdc-dbfa8e3eb9da] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:39:20.487842 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-04cc3994-f70c-4502-a7af-f2fb45677079 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:39:20.488294 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-04cc3994-f70c-4502-a7af-f2fb45677079 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:39:20.489070 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-04cc3994-f70c-4502-a7af-f2fb45677079 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:39:20.489507 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-04cc3994-f70c-4502-a7af-f2fb45677079 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:39:20.665959 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-04cc3994-f70c-4502-a7af-f2fb45677079 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ffe04946139486bb4b976cb0503e0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c37bea771e9a4c26a19ff2ea9ed9d9b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:39:20.673581 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-04cc3994-f70c-4502-a7af-f2fb45677079 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] 10.222.0.46 "GET /compute/v2.1/servers/b9957ec5-1fe1-4a2d-9fdc-dbfa8e3eb9da" status: 200 len: 1453 microversion: 2.1 time: 0.197577 Aug 04 05:39:20.674403 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 558/1101] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:39:20 2022] GET /compute/v2.1/servers/b9957ec5-1fe1-4a2d-9fdc-dbfa8e3eb9da => generated 1453 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:39:20.695837 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-6a67bab6-5b20-44b9-a912-5a122bae66c8 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:39:20.695837 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-6a67bab6-5b20-44b9-a912-5a122bae66c8 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] [instance: b9957ec5-1fe1-4a2d-9fdc-dbfa8e3eb9da] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:39:20.700480 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-6a67bab6-5b20-44b9-a912-5a122bae66c8 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:39:20.700928 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-6a67bab6-5b20-44b9-a912-5a122bae66c8 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:39:20.701693 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-6a67bab6-5b20-44b9-a912-5a122bae66c8 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:39:20.702129 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-6a67bab6-5b20-44b9-a912-5a122bae66c8 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:39:20.706887 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG dbcounter [-] [118476] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:39:20.929542 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-6a67bab6-5b20-44b9-a912-5a122bae66c8 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ffe04946139486bb4b976cb0503e0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c37bea771e9a4c26a19ff2ea9ed9d9b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:39:20.937851 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-6a67bab6-5b20-44b9-a912-5a122bae66c8 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] 10.222.0.46 "GET /compute/v2.1/servers/b9957ec5-1fe1-4a2d-9fdc-dbfa8e3eb9da" status: 200 len: 1453 microversion: 2.1 time: 0.247195 Aug 04 05:39:20.938760 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 544/1102] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:39:20 2022] GET /compute/v2.1/servers/b9957ec5-1fe1-4a2d-9fdc-dbfa8e3eb9da => generated 1453 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:39:23.018999 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [req-98a0f93b-6f24-4458-8ef5-712448e4970e req-ff0611e2-6c08-45f5-aca2-ee6c8af64bc5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b9957ec5-1fe1-4a2d-9fdc-dbfa8e3eb9da", "tag": "2f570185-d303-4660-8d4e-91485facbcf7"}]} {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:39:23.024623 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG dbcounter [-] [118477] Writing DB stats nova_api:SELECT=48,nova_api:INSERT=3 {{(pid=118477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:39:23.029808 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [req-98a0f93b-6f24-4458-8ef5-712448e4970e req-ff0611e2-6c08-45f5-aca2-ee6c8af64bc5 service nova] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:39:23.030273 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [req-98a0f93b-6f24-4458-8ef5-712448e4970e req-ff0611e2-6c08-45f5-aca2-ee6c8af64bc5 service nova] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:39:23.033732 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG dbcounter [-] [118477] Writing DB stats nova_cell1:SELECT=79 {{(pid=118477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:39:23.043023 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.compute.server_external_events [req-98a0f93b-6f24-4458-8ef5-712448e4970e req-ff0611e2-6c08-45f5-aca2-ee6c8af64bc5 service nova] Creating event network-changed:2f570185-d303-4660-8d4e-91485facbcf7 for instance b9957ec5-1fe1-4a2d-9fdc-dbfa8e3eb9da on hv-cinder-85207 Aug 04 05:39:23.048984 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [req-98a0f93b-6f24-4458-8ef5-712448e4970e req-ff0611e2-6c08-45f5-aca2-ee6c8af64bc5 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033776 Aug 04 05:39:23.049646 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 559/1103] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Aug 4 05:39:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:39:37.949004 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-43e052db-8f6d-48ea-a538-9ba06566a13f tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1392150175"}} {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:39:37.949653 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-43e052db-8f6d-48ea-a538-9ba06566a13f tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] [instance: e1f2a355-fc89-41b3-b51e-fe07af415279] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:39:37.951562 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG dbcounter [-] [118476] Writing DB stats nova_api:SELECT=36 {{(pid=118476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:39:37.952180 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG dbcounter [-] [118476] Writing DB stats nova_cell1:SELECT=5 {{(pid=118476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:39:37.957101 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-43e052db-8f6d-48ea-a538-9ba06566a13f tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:39:37.957541 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-43e052db-8f6d-48ea-a538-9ba06566a13f tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:39:37.958362 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-43e052db-8f6d-48ea-a538-9ba06566a13f tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:39:37.958792 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-43e052db-8f6d-48ea-a538-9ba06566a13f tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:39:38.088007 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.network.security_group_api [None req-43e052db-8f6d-48ea-a538-9ba06566a13f tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] Removing security group eed3a355-d83c-4ac4-a5e1-5a97e7e660df from port 5ea44cdb-5862-4ab0-96d6-265ecda6ad7a Aug 04 05:39:38.443192 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-43e052db-8f6d-48ea-a538-9ba06566a13f tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] 10.222.0.46 "POST /compute/v2.1/servers/e1f2a355-fc89-41b3-b51e-fe07af415279/action" status: 202 len: 0 microversion: 2.1 time: 0.498145 Aug 04 05:39:38.443807 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 545/1104] 10.222.0.46 () {60 vars in 1278 bytes} [Thu Aug 4 05:39:37 2022] POST /compute/v2.1/servers/e1f2a355-fc89-41b3-b51e-fe07af415279/action => generated 0 bytes in 499 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 05:39:38.453107 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [req-3a9bfe77-651d-4e2b-817a-16654c1e6475 req-8d08d22d-0af0-4bcb-bb66-574066f45d3b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e1f2a355-fc89-41b3-b51e-fe07af415279", "tag": "5ea44cdb-5862-4ab0-96d6-265ecda6ad7a"}]} {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:39:38.480807 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [req-3a9bfe77-651d-4e2b-817a-16654c1e6475 req-8d08d22d-0af0-4bcb-bb66-574066f45d3b service nova] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:39:38.481248 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [req-3a9bfe77-651d-4e2b-817a-16654c1e6475 req-8d08d22d-0af0-4bcb-bb66-574066f45d3b service nova] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:39:38.506998 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.compute.server_external_events [req-3a9bfe77-651d-4e2b-817a-16654c1e6475 req-8d08d22d-0af0-4bcb-bb66-574066f45d3b service nova] Creating event network-changed:5ea44cdb-5862-4ab0-96d6-265ecda6ad7a for instance e1f2a355-fc89-41b3-b51e-fe07af415279 on hv-cinder-85207 Aug 04 05:39:38.512185 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [req-3a9bfe77-651d-4e2b-817a-16654c1e6475 req-8d08d22d-0af0-4bcb-bb66-574066f45d3b service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064317 Aug 04 05:39:38.512793 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 560/1105] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Aug 4 05:39:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:39:39.581839 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-b94a27ac-2bd2-40d0-9106-4581b1412625 tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:39:39.582423 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-b94a27ac-2bd2-40d0-9106-4581b1412625 tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] [instance: e1f2a355-fc89-41b3-b51e-fe07af415279] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:39:39.588559 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-b94a27ac-2bd2-40d0-9106-4581b1412625 tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:39:39.589146 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-b94a27ac-2bd2-40d0-9106-4581b1412625 tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:39:39.590029 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-b94a27ac-2bd2-40d0-9106-4581b1412625 tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:39:39.590209 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [req-a62873e7-df2c-4db1-9551-62ccb32235ba req-5b0d2c0a-83f0-466f-aafe-8de3764ac387 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e1f2a355-fc89-41b3-b51e-fe07af415279", "tag": "5ea44cdb-5862-4ab0-96d6-265ecda6ad7a"}]} {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:39:39.590677 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-b94a27ac-2bd2-40d0-9106-4581b1412625 tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:39:39.599964 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [req-a62873e7-df2c-4db1-9551-62ccb32235ba req-5b0d2c0a-83f0-466f-aafe-8de3764ac387 service nova] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:39:39.600403 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [req-a62873e7-df2c-4db1-9551-62ccb32235ba req-5b0d2c0a-83f0-466f-aafe-8de3764ac387 service nova] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:39:39.615810 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.compute.server_external_events [req-a62873e7-df2c-4db1-9551-62ccb32235ba req-5b0d2c0a-83f0-466f-aafe-8de3764ac387 service nova] Creating event network-changed:5ea44cdb-5862-4ab0-96d6-265ecda6ad7a for instance e1f2a355-fc89-41b3-b51e-fe07af415279 on hv-cinder-85207 Aug 04 05:39:39.620714 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [req-a62873e7-df2c-4db1-9551-62ccb32235ba req-5b0d2c0a-83f0-466f-aafe-8de3764ac387 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034287 Aug 04 05:39:39.621669 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 561/1106] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Aug 4 05:39:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:39:39.677465 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.objects.instance [None req-b94a27ac-2bd2-40d0-9106-4581b1412625 tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] Lazy-loading 'services' on Instance uuid e1f2a355-fc89-41b3-b51e-fe07af415279 {{(pid=118476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 05:39:39.899301 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-b94a27ac-2bd2-40d0-9106-4581b1412625 tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] 10.222.0.46 "DELETE /compute/v2.1/servers/e1f2a355-fc89-41b3-b51e-fe07af415279/os-volume_attachments/ff0de8b5-a13b-4756-bc98-7b6ac1ccd046" status: 202 len: 0 microversion: 2.1 time: 0.322362 Aug 04 05:39:39.903582 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 546/1107] 10.222.0.46 () {58 vars in 1416 bytes} [Thu Aug 4 05:39:39 2022] DELETE /compute/v2.1/servers/e1f2a355-fc89-41b3-b51e-fe07af415279/os-volume_attachments/ff0de8b5-a13b-4756-bc98-7b6ac1ccd046 => generated 0 bytes in 325 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 05:39:39.910240 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-04b65875-a944-4523-b2ce-de36c31a5c82 tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:39:39.914246 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-04b65875-a944-4523-b2ce-de36c31a5c82 tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] [instance: e1f2a355-fc89-41b3-b51e-fe07af415279] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:39:39.922261 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-04b65875-a944-4523-b2ce-de36c31a5c82 tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:39:39.923075 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-04b65875-a944-4523-b2ce-de36c31a5c82 tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:39:39.924028 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-04b65875-a944-4523-b2ce-de36c31a5c82 tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:39:39.924525 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-04b65875-a944-4523-b2ce-de36c31a5c82 tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:39:39.956039 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-04b65875-a944-4523-b2ce-de36c31a5c82 tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] 10.222.0.46 "GET /compute/v2.1/servers/e1f2a355-fc89-41b3-b51e-fe07af415279/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050630 Aug 04 05:39:39.956723 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 562/1108] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Aug 4 05:39:39 2022] GET /compute/v2.1/servers/e1f2a355-fc89-41b3-b51e-fe07af415279/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:39:40.971104 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-3688241a-b97c-4d4e-8a41-486c2021cb63 tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:39:40.973462 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-3688241a-b97c-4d4e-8a41-486c2021cb63 tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] [instance: e1f2a355-fc89-41b3-b51e-fe07af415279] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:39:40.979981 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-3688241a-b97c-4d4e-8a41-486c2021cb63 tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:39:40.980430 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-3688241a-b97c-4d4e-8a41-486c2021cb63 tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:39:40.981225 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-3688241a-b97c-4d4e-8a41-486c2021cb63 tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:39:40.981722 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-3688241a-b97c-4d4e-8a41-486c2021cb63 tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:39:41.014952 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-3688241a-b97c-4d4e-8a41-486c2021cb63 tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] 10.222.0.46 "GET /compute/v2.1/servers/e1f2a355-fc89-41b3-b51e-fe07af415279/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049374 Aug 04 05:39:41.015801 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 547/1109] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Aug 4 05:39:40 2022] GET /compute/v2.1/servers/e1f2a355-fc89-41b3-b51e-fe07af415279/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:39:42.027255 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-4445ed34-6c6a-40ba-853a-97aefd11730d tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:39:42.029389 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-4445ed34-6c6a-40ba-853a-97aefd11730d tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] [instance: e1f2a355-fc89-41b3-b51e-fe07af415279] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:39:42.035830 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-4445ed34-6c6a-40ba-853a-97aefd11730d tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:39:42.036277 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-4445ed34-6c6a-40ba-853a-97aefd11730d tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:39:42.037034 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-4445ed34-6c6a-40ba-853a-97aefd11730d tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:39:42.037467 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-4445ed34-6c6a-40ba-853a-97aefd11730d tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:39:42.065556 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-4445ed34-6c6a-40ba-853a-97aefd11730d tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] 10.222.0.46 "GET /compute/v2.1/servers/e1f2a355-fc89-41b3-b51e-fe07af415279/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042541 Aug 04 05:39:42.066099 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 563/1110] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Aug 4 05:39:42 2022] GET /compute/v2.1/servers/e1f2a355-fc89-41b3-b51e-fe07af415279/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 05:39:42.076411 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-c2ad494e-5152-4a5b-b7b0-9606cccbef3d tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:39:42.076893 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-c2ad494e-5152-4a5b-b7b0-9606cccbef3d tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] [instance: e1f2a355-fc89-41b3-b51e-fe07af415279] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:39:42.084381 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-c2ad494e-5152-4a5b-b7b0-9606cccbef3d tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:39:42.084826 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-c2ad494e-5152-4a5b-b7b0-9606cccbef3d tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:39:42.085584 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-c2ad494e-5152-4a5b-b7b0-9606cccbef3d tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:39:42.086045 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-c2ad494e-5152-4a5b-b7b0-9606cccbef3d tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:39:42.158218 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.wsgi [None req-c2ad494e-5152-4a5b-b7b0-9606cccbef3d tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] HTTP exception thrown: Instance e1f2a355-fc89-41b3-b51e-fe07af415279 is not attached to volume ff0de8b5-a13b-4756-bc98-7b6ac1ccd046 Aug 04 05:39:42.160605 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-c2ad494e-5152-4a5b-b7b0-9606cccbef3d tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] Request method failure captured: Aug 04 05:39:42.160605 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: request: DELETE /compute/v2.1/servers/e1f2a355-fc89-41b3-b51e-fe07af415279/os-volume_attachments/ff0de8b5-a13b-4756-bc98-7b6ac1ccd046 HTTP/1.1 Aug 04 05:39:42.160605 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: Accept: application/json Aug 04 05:39:42.160605 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: Accept-Encoding: identity Aug 04 05:39:42.160605 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: Connection: close Aug 04 05:39:42.160605 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: Content-Length: 0 Aug 04 05:39:42.160605 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: Content-Type: application/json Aug 04 05:39:42.160605 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: Host: 10.222.0.46 Aug 04 05:39:42.160605 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: Openstack-System-Scope: None Aug 04 05:39:42.160605 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: User-Agent: python-urllib3/1.26.11 Aug 04 05:39:42.160605 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Auth-Token: gAAAAABi61sn-Zglbq7RRvCO12bB_8Q7vxZOLLZx5hRRVf-09c3sFYEO7HbTzTcsMXvXvK59lZmi2VOnuumpTQ-x8gOqrKjIdTquZMzoj9ygOkQhcj_AfH7mSRYsD21QD1hFDHlknF5BNI2NiaZGm9t6h_DqrnqtL8ilPvPUFinHfpq_kXJEnNY Aug 04 05:39:42.160605 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Domain-Id: None Aug 04 05:39:42.160605 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Domain-Name: None Aug 04 05:39:42.160605 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Identity-Status: Confirmed Aug 04 05:39:42.160605 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Is-Admin-Project: True Aug 04 05:39:42.160605 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Project-Domain-Id: default Aug 04 05:39:42.160605 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Project-Domain-Name: Default Aug 04 05:39:42.160605 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Project-Id: 49ee5ac3fb644e24973f40ede2c94de7 Aug 04 05:39:42.160605 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Project-Name: tempest-TestMinimumBasicScenario-1273524247 Aug 04 05:39:42.160605 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Role: member,reader Aug 04 05:39:42.160605 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Roles: member,reader Aug 04 05:39:42.162250 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/49ee5ac3fb644e24973f40ede2c94de7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/49ee5ac3fb644e24973f40ede2c94de7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_49ee5ac3fb644e24973f40ede2c94de7", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/49ee5ac3fb644e24973f40ede2c94de7"}]}] Aug 04 05:39:42.162250 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Tenant: tempest-TestMinimumBasicScenario-1273524247 Aug 04 05:39:42.162250 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Tenant-Id: 49ee5ac3fb644e24973f40ede2c94de7 Aug 04 05:39:42.162250 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1273524247 Aug 04 05:39:42.162250 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-User: tempest-TestMinimumBasicScenario-1273524247-project Aug 04 05:39:42.162250 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-User-Domain-Id: default Aug 04 05:39:42.162250 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-User-Domain-Name: Default Aug 04 05:39:42.162250 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-User-Id: c8ff7be84ccd459cb7159bcffc1de249 Aug 04 05:39:42.162250 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-User-Name: tempest-TestMinimumBasicScenario-1273524247-project Aug 04 05:39:42.162250 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: method: > Aug 04 05:39:42.162250 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: exception: Instance e1f2a355-fc89-41b3-b51e-fe07af415279 is not attached to volume ff0de8b5-a13b-4756-bc98-7b6ac1ccd046 Aug 04 05:39:42.163071 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: action_args: {'server_id': 'e1f2a355-fc89-41b3-b51e-fe07af415279', 'id': 'ff0de8b5-a13b-4756-bc98-7b6ac1ccd046'} Aug 04 05:39:42.163071 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 05:39:42.163071 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:39:42.163071 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 04 05:39:42.163071 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 04 05:39:42.163071 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 04 05:39:42.163071 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 04 05:39:42.163071 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Aug 04 05:39:42.163071 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 04 05:39:42.163071 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id ff0de8b5-a13b-4756-bc98-7b6ac1ccd046. Aug 04 05:39:42.163071 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Aug 04 05:39:42.163071 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:39:42.163071 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Aug 04 05:39:42.163071 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:39:42.163071 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:39:42.163071 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:39:42.163071 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 05:39:42.163071 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 05:39:42.163071 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 05:39:42.164418 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 05:39:42.164418 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 04 05:39:42.164418 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 04 05:39:42.164418 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e1f2a355-fc89-41b3-b51e-fe07af415279 is not attached to volume ff0de8b5-a13b-4756-bc98-7b6ac1ccd046 Aug 04 05:39:42.164418 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Aug 04 05:39:42.164418 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:39:42.164418 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Aug 04 05:39:42.164418 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:39:42.164418 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:39:42.164418 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:39:42.164418 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 05:39:42.164418 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 05:39:42.164418 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e1f2a355-fc89-41b3-b51e-fe07af415279 is not attached to volume ff0de8b5-a13b-4756-bc98-7b6ac1ccd046 Aug 04 05:39:42.164418 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Aug 04 05:39:42.164418 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-c2ad494e-5152-4a5b-b7b0-9606cccbef3d tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] Returning 404 to user: Instance e1f2a355-fc89-41b3-b51e-fe07af415279 is not attached to volume ff0de8b5-a13b-4756-bc98-7b6ac1ccd046 {{(pid=118476) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 05:39:42.165418 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-c2ad494e-5152-4a5b-b7b0-9606cccbef3d tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] 10.222.0.46 "DELETE /compute/v2.1/servers/e1f2a355-fc89-41b3-b51e-fe07af415279/os-volume_attachments/ff0de8b5-a13b-4756-bc98-7b6ac1ccd046" status: 404 len: 154 microversion: 2.1 time: 0.089506 Aug 04 05:39:42.165418 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 548/1111] 10.222.0.46 () {58 vars in 1416 bytes} [Thu Aug 4 05:39:42 2022] DELETE /compute/v2.1/servers/e1f2a355-fc89-41b3-b51e-fe07af415279/os-volume_attachments/ff0de8b5-a13b-4756-bc98-7b6ac1ccd046 => generated 154 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 05:39:43.402244 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-c946acd3-969c-43b7-a786-c2a6a351d56c tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:39:43.402866 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-c946acd3-969c-43b7-a786-c2a6a351d56c tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] [instance: e1f2a355-fc89-41b3-b51e-fe07af415279] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:39:43.409165 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-c946acd3-969c-43b7-a786-c2a6a351d56c tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:39:43.409613 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-c946acd3-969c-43b7-a786-c2a6a351d56c tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:39:43.410397 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-c946acd3-969c-43b7-a786-c2a6a351d56c tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:39:43.410834 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-c946acd3-969c-43b7-a786-c2a6a351d56c tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:39:43.436013 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-c946acd3-969c-43b7-a786-c2a6a351d56c tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] [instance: e1f2a355-fc89-41b3-b51e-fe07af415279] Going to try to terminate instance {{(pid=118477) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 05:39:43.703981 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-c946acd3-969c-43b7-a786-c2a6a351d56c tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] 10.222.0.46 "DELETE /compute/v2.1/servers/e1f2a355-fc89-41b3-b51e-fe07af415279" status: 204 len: 0 microversion: 2.1 time: 0.305459 Aug 04 05:39:43.704504 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 564/1112] 10.222.0.46 () {58 vars in 1239 bytes} [Thu Aug 4 05:39:43 2022] DELETE /compute/v2.1/servers/e1f2a355-fc89-41b3-b51e-fe07af415279 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 05:39:43.713256 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-1ea6d289-a4d1-4d50-ba63-68867fe52f77 tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:39:43.713871 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-1ea6d289-a4d1-4d50-ba63-68867fe52f77 tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] [instance: e1f2a355-fc89-41b3-b51e-fe07af415279] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:39:43.720356 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-1ea6d289-a4d1-4d50-ba63-68867fe52f77 tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:39:43.720834 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-1ea6d289-a4d1-4d50-ba63-68867fe52f77 tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:39:43.721766 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-1ea6d289-a4d1-4d50-ba63-68867fe52f77 tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:39:43.722188 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-1ea6d289-a4d1-4d50-ba63-68867fe52f77 tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:39:43.858186 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-1ea6d289-a4d1-4d50-ba63-68867fe52f77 tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ff7be84ccd459cb7159bcffc1de249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ee5ac3fb644e24973f40ede2c94de7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:39:43.866607 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-1ea6d289-a4d1-4d50-ba63-68867fe52f77 tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] 10.222.0.46 "GET /compute/v2.1/servers/e1f2a355-fc89-41b3-b51e-fe07af415279" status: 200 len: 1556 microversion: 2.1 time: 0.157396 Aug 04 05:39:43.867176 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 549/1113] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:39:43 2022] GET /compute/v2.1/servers/e1f2a355-fc89-41b3-b51e-fe07af415279 => generated 1556 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 05:39:44.889740 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-36ff83df-2aac-420b-b94f-8ebd8958e2ff tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:39:44.890463 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-36ff83df-2aac-420b-b94f-8ebd8958e2ff tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] [instance: e1f2a355-fc89-41b3-b51e-fe07af415279] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:39:44.897323 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-36ff83df-2aac-420b-b94f-8ebd8958e2ff tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:39:44.897752 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-36ff83df-2aac-420b-b94f-8ebd8958e2ff tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:39:44.898529 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-36ff83df-2aac-420b-b94f-8ebd8958e2ff tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:39:44.899244 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-36ff83df-2aac-420b-b94f-8ebd8958e2ff tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:39:45.028001 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-36ff83df-2aac-420b-b94f-8ebd8958e2ff tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ff7be84ccd459cb7159bcffc1de249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ee5ac3fb644e24973f40ede2c94de7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:39:45.036693 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-36ff83df-2aac-420b-b94f-8ebd8958e2ff tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] 10.222.0.46 "GET /compute/v2.1/servers/e1f2a355-fc89-41b3-b51e-fe07af415279" status: 200 len: 1556 microversion: 2.1 time: 0.151047 Aug 04 05:39:45.037260 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 565/1114] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:39:44 2022] GET /compute/v2.1/servers/e1f2a355-fc89-41b3-b51e-fe07af415279 => generated 1556 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:39:46.057722 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-05619b4b-fdff-4bda-80ef-d8f4abf6aacc tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:39:46.058326 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-05619b4b-fdff-4bda-80ef-d8f4abf6aacc tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] [instance: e1f2a355-fc89-41b3-b51e-fe07af415279] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:39:46.065022 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-05619b4b-fdff-4bda-80ef-d8f4abf6aacc tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:39:46.065477 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-05619b4b-fdff-4bda-80ef-d8f4abf6aacc tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:39:46.066235 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-05619b4b-fdff-4bda-80ef-d8f4abf6aacc tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:39:46.066734 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-05619b4b-fdff-4bda-80ef-d8f4abf6aacc tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:39:46.175656 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-05619b4b-fdff-4bda-80ef-d8f4abf6aacc tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ff7be84ccd459cb7159bcffc1de249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ee5ac3fb644e24973f40ede2c94de7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:39:46.182964 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-05619b4b-fdff-4bda-80ef-d8f4abf6aacc tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] 10.222.0.46 "GET /compute/v2.1/servers/e1f2a355-fc89-41b3-b51e-fe07af415279" status: 200 len: 1514 microversion: 2.1 time: 0.129205 Aug 04 05:39:46.183819 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 550/1115] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:39:46 2022] GET /compute/v2.1/servers/e1f2a355-fc89-41b3-b51e-fe07af415279 => generated 1514 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:39:46.214939 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [req-f9c86719-3a1a-4776-912c-0787fcd071fc req-e56eece1-92f5-46b8-81c0-74d6b77f6200 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1f2a355-fc89-41b3-b51e-fe07af415279", "name": "network-vif-deleted", "tag": "5ea44cdb-5862-4ab0-96d6-265ecda6ad7a"}]} {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:39:46.226073 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [req-f9c86719-3a1a-4776-912c-0787fcd071fc req-e56eece1-92f5-46b8-81c0-74d6b77f6200 service nova] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:39:46.226892 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [req-f9c86719-3a1a-4776-912c-0787fcd071fc req-e56eece1-92f5-46b8-81c0-74d6b77f6200 service nova] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:39:46.239462 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.compute.server_external_events [req-f9c86719-3a1a-4776-912c-0787fcd071fc req-e56eece1-92f5-46b8-81c0-74d6b77f6200 service nova] Creating event network-vif-deleted:5ea44cdb-5862-4ab0-96d6-265ecda6ad7a for instance e1f2a355-fc89-41b3-b51e-fe07af415279 on hv-cinder-85207 Aug 04 05:39:46.245111 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [req-f9c86719-3a1a-4776-912c-0787fcd071fc req-e56eece1-92f5-46b8-81c0-74d6b77f6200 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033762 Aug 04 05:39:46.245720 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 566/1116] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Aug 4 05:39:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:39:47.204752 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-bf9911ac-6d50-4920-aa9d-99c5f7edb6dd tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:39:47.205368 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-bf9911ac-6d50-4920-aa9d-99c5f7edb6dd tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] [instance: e1f2a355-fc89-41b3-b51e-fe07af415279] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:39:47.212640 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-bf9911ac-6d50-4920-aa9d-99c5f7edb6dd tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:39:47.215874 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-bf9911ac-6d50-4920-aa9d-99c5f7edb6dd tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:39:47.215874 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-bf9911ac-6d50-4920-aa9d-99c5f7edb6dd tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:39:47.215874 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-bf9911ac-6d50-4920-aa9d-99c5f7edb6dd tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:39:47.227821 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.wsgi [None req-bf9911ac-6d50-4920-aa9d-99c5f7edb6dd tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] HTTP exception thrown: Instance e1f2a355-fc89-41b3-b51e-fe07af415279 could not be found. Aug 04 05:39:47.229381 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-bf9911ac-6d50-4920-aa9d-99c5f7edb6dd tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] Request method failure captured: Aug 04 05:39:47.229381 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: request: GET /compute/v2.1/servers/e1f2a355-fc89-41b3-b51e-fe07af415279 HTTP/1.1 Aug 04 05:39:47.229381 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: Accept: application/json Aug 04 05:39:47.229381 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: Accept-Encoding: identity Aug 04 05:39:47.229381 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: Connection: close Aug 04 05:39:47.229381 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: Content-Length: 0 Aug 04 05:39:47.229381 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: Content-Type: application/json Aug 04 05:39:47.229381 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: Host: 10.222.0.46 Aug 04 05:39:47.229381 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: Openstack-System-Scope: None Aug 04 05:39:47.229381 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: User-Agent: python-urllib3/1.26.11 Aug 04 05:39:47.229381 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Auth-Token: gAAAAABi61sn-Zglbq7RRvCO12bB_8Q7vxZOLLZx5hRRVf-09c3sFYEO7HbTzTcsMXvXvK59lZmi2VOnuumpTQ-x8gOqrKjIdTquZMzoj9ygOkQhcj_AfH7mSRYsD21QD1hFDHlknF5BNI2NiaZGm9t6h_DqrnqtL8ilPvPUFinHfpq_kXJEnNY Aug 04 05:39:47.229381 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Domain-Id: None Aug 04 05:39:47.229381 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Domain-Name: None Aug 04 05:39:47.229381 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Identity-Status: Confirmed Aug 04 05:39:47.229381 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Is-Admin-Project: True Aug 04 05:39:47.229381 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Project-Domain-Id: default Aug 04 05:39:47.229381 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Project-Domain-Name: Default Aug 04 05:39:47.229381 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Project-Id: 49ee5ac3fb644e24973f40ede2c94de7 Aug 04 05:39:47.229381 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Project-Name: tempest-TestMinimumBasicScenario-1273524247 Aug 04 05:39:47.229381 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Role: member,reader Aug 04 05:39:47.229381 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Roles: member,reader Aug 04 05:39:47.231187 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/49ee5ac3fb644e24973f40ede2c94de7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/49ee5ac3fb644e24973f40ede2c94de7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_49ee5ac3fb644e24973f40ede2c94de7", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/49ee5ac3fb644e24973f40ede2c94de7"}]}] Aug 04 05:39:47.231187 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Tenant: tempest-TestMinimumBasicScenario-1273524247 Aug 04 05:39:47.231187 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Tenant-Id: 49ee5ac3fb644e24973f40ede2c94de7 Aug 04 05:39:47.231187 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1273524247 Aug 04 05:39:47.231187 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-User: tempest-TestMinimumBasicScenario-1273524247-project Aug 04 05:39:47.231187 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-User-Domain-Id: default Aug 04 05:39:47.231187 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-User-Domain-Name: Default Aug 04 05:39:47.231187 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-User-Id: c8ff7be84ccd459cb7159bcffc1de249 Aug 04 05:39:47.231187 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-User-Name: tempest-TestMinimumBasicScenario-1273524247-project Aug 04 05:39:47.231187 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: method: > Aug 04 05:39:47.231187 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: exception: Instance e1f2a355-fc89-41b3-b51e-fe07af415279 could not be found. Aug 04 05:39:47.231187 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: action_args: {'id': 'e1f2a355-fc89-41b3-b51e-fe07af415279'} Aug 04 05:39:47.232084 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 05:39:47.232084 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:39:47.232084 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 05:39:47.232084 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 05:39:47.232084 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 05:39:47.232084 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 05:39:47.232084 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 05:39:47.232084 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 05:39:47.232084 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 05:39:47.232084 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 05:39:47.232084 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e1f2a355-fc89-41b3-b51e-fe07af415279 could not be found. Aug 04 05:39:47.232084 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Aug 04 05:39:47.232084 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:39:47.232084 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Aug 04 05:39:47.232084 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:39:47.232084 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:39:47.232084 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:39:47.232084 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 05:39:47.232084 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 05:39:47.232084 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 05:39:47.233462 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 05:39:47.233462 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 05:39:47.233462 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 05:39:47.233462 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 05:39:47.233462 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 05:39:47.233462 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 05:39:47.233462 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 05:39:47.233462 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e1f2a355-fc89-41b3-b51e-fe07af415279 could not be found. Aug 04 05:39:47.233462 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Aug 04 05:39:47.233462 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:39:47.233462 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Aug 04 05:39:47.233462 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:39:47.233462 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:39:47.233462 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:39:47.233462 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 05:39:47.233462 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 05:39:47.233462 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e1f2a355-fc89-41b3-b51e-fe07af415279 could not be found. Aug 04 05:39:47.233462 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Aug 04 05:39:47.243845 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-bf9911ac-6d50-4920-aa9d-99c5f7edb6dd tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] Returning 404 to user: Instance e1f2a355-fc89-41b3-b51e-fe07af415279 could not be found. {{(pid=118476) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 05:39:47.243845 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-bf9911ac-6d50-4920-aa9d-99c5f7edb6dd tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] 10.222.0.46 "GET /compute/v2.1/servers/e1f2a355-fc89-41b3-b51e-fe07af415279" status: 404 len: 111 microversion: 2.1 time: 0.030044 Aug 04 05:39:47.243845 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 551/1117] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:39:47 2022] GET /compute/v2.1/servers/e1f2a355-fc89-41b3-b51e-fe07af415279 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 05:39:47.244127 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-7d586ac1-92bb-440b-afd1-016dbb11b5cb tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] Calling method '.version_select at 0x7f147568a670>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:39:47.327172 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-7d586ac1-92bb-440b-afd1-016dbb11b5cb tempest-TestMinimumBasicScenario-1273524247 tempest-TestMinimumBasicScenario-1273524247-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1669749350" status: 202 len: 0 microversion: 2.1 time: 0.091184 Aug 04 05:39:47.327752 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 567/1118] 10.222.0.46 () {58 vars in 1272 bytes} [Thu Aug 4 05:39:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1669749350 => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 05:40:17.180711 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 05:40:17.181266 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: Thu Aug 4 05:40:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 05:40:29.128968 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 05:40:29.129704 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: Thu Aug 4 05:40:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 05:40:52.564509 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG dbcounter [-] [118477] Writing DB stats nova_cell1:SELECT=39,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:40:52.565273 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG dbcounter [-] [118477] Writing DB stats nova_api:SELECT=23,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=118477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:40:52.569423 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [req-7074694f-b335-4b68-8e8b-b31e2027fa82 req-ca56ae01-d4aa-4ae3-aada-e0a5a6a8310c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b9957ec5-1fe1-4a2d-9fdc-dbfa8e3eb9da", "tag": "2f570185-d303-4660-8d4e-91485facbcf7"}]} {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:40:52.575391 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG dbcounter [-] [118476] Writing DB stats nova_api:SELECT=14 {{(pid=118476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:40:52.576139 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG dbcounter [-] [118476] Writing DB stats nova_cell1:SELECT=39,nova_cell1:INSERT=1 {{(pid=118476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:40:52.580027 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-fb0e71d6-ef7c-49ca-9695-ee7444be2620 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:40:52.580518 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-fb0e71d6-ef7c-49ca-9695-ee7444be2620 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] [instance: b9957ec5-1fe1-4a2d-9fdc-dbfa8e3eb9da] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:40:52.588059 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-fb0e71d6-ef7c-49ca-9695-ee7444be2620 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:40:52.588715 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-fb0e71d6-ef7c-49ca-9695-ee7444be2620 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:40:52.591234 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-fb0e71d6-ef7c-49ca-9695-ee7444be2620 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:40:52.591366 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [req-7074694f-b335-4b68-8e8b-b31e2027fa82 req-ca56ae01-d4aa-4ae3-aada-e0a5a6a8310c service nova] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:40:52.591477 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-fb0e71d6-ef7c-49ca-9695-ee7444be2620 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:40:52.591570 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [req-7074694f-b335-4b68-8e8b-b31e2027fa82 req-ca56ae01-d4aa-4ae3-aada-e0a5a6a8310c service nova] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:40:52.603920 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.compute.server_external_events [req-7074694f-b335-4b68-8e8b-b31e2027fa82 req-ca56ae01-d4aa-4ae3-aada-e0a5a6a8310c service nova] Creating event network-changed:2f570185-d303-4660-8d4e-91485facbcf7 for instance b9957ec5-1fe1-4a2d-9fdc-dbfa8e3eb9da on hv-cinder-85207 Aug 04 05:40:52.609149 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [req-7074694f-b335-4b68-8e8b-b31e2027fa82 req-ca56ae01-d4aa-4ae3-aada-e0a5a6a8310c service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046546 Aug 04 05:40:52.610098 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 568/1119] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Aug 4 05:40:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:40:52.621799 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-fb0e71d6-ef7c-49ca-9695-ee7444be2620 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] [instance: b9957ec5-1fe1-4a2d-9fdc-dbfa8e3eb9da] Going to try to terminate instance {{(pid=118476) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 05:40:52.885512 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-fb0e71d6-ef7c-49ca-9695-ee7444be2620 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] 10.222.0.46 "DELETE /compute/v2.1/servers/b9957ec5-1fe1-4a2d-9fdc-dbfa8e3eb9da" status: 204 len: 0 microversion: 2.1 time: 0.325134 Aug 04 05:40:52.889163 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 552/1120] 10.222.0.46 () {58 vars in 1239 bytes} [Thu Aug 4 05:40:52 2022] DELETE /compute/v2.1/servers/b9957ec5-1fe1-4a2d-9fdc-dbfa8e3eb9da => generated 0 bytes in 327 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 05:40:52.900385 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-315fe4dc-b2be-466b-beb6-f3fcba46b56b tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:40:52.900385 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-315fe4dc-b2be-466b-beb6-f3fcba46b56b tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] [instance: b9957ec5-1fe1-4a2d-9fdc-dbfa8e3eb9da] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:40:52.904033 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-315fe4dc-b2be-466b-beb6-f3fcba46b56b tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:40:52.904477 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-315fe4dc-b2be-466b-beb6-f3fcba46b56b tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:40:52.905446 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-315fe4dc-b2be-466b-beb6-f3fcba46b56b tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:40:52.905940 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-315fe4dc-b2be-466b-beb6-f3fcba46b56b tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:40:53.162662 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-315fe4dc-b2be-466b-beb6-f3fcba46b56b tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ffe04946139486bb4b976cb0503e0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c37bea771e9a4c26a19ff2ea9ed9d9b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:40:53.170957 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-315fe4dc-b2be-466b-beb6-f3fcba46b56b tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] 10.222.0.46 "GET /compute/v2.1/servers/b9957ec5-1fe1-4a2d-9fdc-dbfa8e3eb9da" status: 200 len: 1577 microversion: 2.1 time: 0.280306 Aug 04 05:40:53.171533 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 569/1121] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:40:52 2022] GET /compute/v2.1/servers/b9957ec5-1fe1-4a2d-9fdc-dbfa8e3eb9da => generated 1577 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:40:54.192427 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-d94cadce-540f-4cf7-b32f-9d6488996c91 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:40:54.193130 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-d94cadce-540f-4cf7-b32f-9d6488996c91 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] [instance: b9957ec5-1fe1-4a2d-9fdc-dbfa8e3eb9da] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:40:54.200138 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-d94cadce-540f-4cf7-b32f-9d6488996c91 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:40:54.200583 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-d94cadce-540f-4cf7-b32f-9d6488996c91 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:40:54.201343 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-d94cadce-540f-4cf7-b32f-9d6488996c91 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:40:54.201779 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-d94cadce-540f-4cf7-b32f-9d6488996c91 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:40:54.384270 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-d94cadce-540f-4cf7-b32f-9d6488996c91 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ffe04946139486bb4b976cb0503e0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c37bea771e9a4c26a19ff2ea9ed9d9b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:40:54.391766 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-d94cadce-540f-4cf7-b32f-9d6488996c91 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] 10.222.0.46 "GET /compute/v2.1/servers/b9957ec5-1fe1-4a2d-9fdc-dbfa8e3eb9da" status: 200 len: 1577 microversion: 2.1 time: 0.203606 Aug 04 05:40:54.392335 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 553/1122] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:40:54 2022] GET /compute/v2.1/servers/b9957ec5-1fe1-4a2d-9fdc-dbfa8e3eb9da => generated 1577 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:40:55.066440 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [req-e51f85ca-296d-4338-800e-edc8e99f3720 req-e3ddbb2d-f8fd-4b51-8867-4cf25fac006e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9957ec5-1fe1-4a2d-9fdc-dbfa8e3eb9da", "name": "network-vif-deleted", "tag": "2f570185-d303-4660-8d4e-91485facbcf7"}]} {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:40:55.076418 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [req-e51f85ca-296d-4338-800e-edc8e99f3720 req-e3ddbb2d-f8fd-4b51-8867-4cf25fac006e service nova] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:40:55.078446 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [req-e51f85ca-296d-4338-800e-edc8e99f3720 req-e3ddbb2d-f8fd-4b51-8867-4cf25fac006e service nova] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:40:55.087497 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.compute.server_external_events [req-e51f85ca-296d-4338-800e-edc8e99f3720 req-e3ddbb2d-f8fd-4b51-8867-4cf25fac006e service nova] Creating event network-vif-deleted:2f570185-d303-4660-8d4e-91485facbcf7 for instance b9957ec5-1fe1-4a2d-9fdc-dbfa8e3eb9da on hv-cinder-85207 Aug 04 05:40:55.092115 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [req-e51f85ca-296d-4338-800e-edc8e99f3720 req-e3ddbb2d-f8fd-4b51-8867-4cf25fac006e service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029457 Aug 04 05:40:55.092689 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 570/1123] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Aug 4 05:40:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 05:40:55.413105 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-07425594-1ca8-46ed-9a3f-20e4129fd53d tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:40:55.418841 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-07425594-1ca8-46ed-9a3f-20e4129fd53d tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] [instance: b9957ec5-1fe1-4a2d-9fdc-dbfa8e3eb9da] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:40:55.421033 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-07425594-1ca8-46ed-9a3f-20e4129fd53d tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:40:55.421491 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-07425594-1ca8-46ed-9a3f-20e4129fd53d tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:40:55.422269 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-07425594-1ca8-46ed-9a3f-20e4129fd53d tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:40:55.422772 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-07425594-1ca8-46ed-9a3f-20e4129fd53d tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:40:55.491852 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-07425594-1ca8-46ed-9a3f-20e4129fd53d tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ffe04946139486bb4b976cb0503e0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c37bea771e9a4c26a19ff2ea9ed9d9b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:40:55.499489 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-07425594-1ca8-46ed-9a3f-20e4129fd53d tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] 10.222.0.46 "GET /compute/v2.1/servers/b9957ec5-1fe1-4a2d-9fdc-dbfa8e3eb9da" status: 200 len: 1226 microversion: 2.1 time: 0.090253 Aug 04 05:40:55.500057 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 554/1124] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:40:55 2022] GET /compute/v2.1/servers/b9957ec5-1fe1-4a2d-9fdc-dbfa8e3eb9da => generated 1226 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:40:56.521784 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-64aabfc9-b152-4faf-842c-a25d981f5362 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:40:56.522511 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-64aabfc9-b152-4faf-842c-a25d981f5362 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] [instance: b9957ec5-1fe1-4a2d-9fdc-dbfa8e3eb9da] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:40:56.529356 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-64aabfc9-b152-4faf-842c-a25d981f5362 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:40:56.529852 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-64aabfc9-b152-4faf-842c-a25d981f5362 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:40:56.530635 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-64aabfc9-b152-4faf-842c-a25d981f5362 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:40:56.531086 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-64aabfc9-b152-4faf-842c-a25d981f5362 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:40:56.545620 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.wsgi [None req-64aabfc9-b152-4faf-842c-a25d981f5362 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] HTTP exception thrown: Instance b9957ec5-1fe1-4a2d-9fdc-dbfa8e3eb9da could not be found. Aug 04 05:40:56.547309 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-64aabfc9-b152-4faf-842c-a25d981f5362 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Request method failure captured: Aug 04 05:40:56.547309 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: request: GET /compute/v2.1/servers/b9957ec5-1fe1-4a2d-9fdc-dbfa8e3eb9da HTTP/1.1 Aug 04 05:40:56.547309 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: Accept: application/json Aug 04 05:40:56.547309 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: Accept-Encoding: identity Aug 04 05:40:56.547309 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: Connection: close Aug 04 05:40:56.547309 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: Content-Length: 0 Aug 04 05:40:56.547309 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: Content-Type: application/json Aug 04 05:40:56.547309 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: Host: 10.222.0.46 Aug 04 05:40:56.547309 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: Openstack-System-Scope: None Aug 04 05:40:56.547309 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: User-Agent: python-urllib3/1.26.11 Aug 04 05:40:56.547309 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Auth-Token: gAAAAABi61pYvx3dS9u4vxk8gLHoxOEk4CNZqQKH6zCkbT29GENfbkkacpdsTIXgj1467iXjea5SO3HK7aggn_GgYiFd0uVYEHt3ICpPoC7qXIDGU8tUx2lDjPs2Inox06ZyU0ZYM8CsnwC6lyX9ku6_UWl_mzqFlVdyHqiHZh9ayVz7tHGScuU Aug 04 05:40:56.547309 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Domain-Id: None Aug 04 05:40:56.547309 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Domain-Name: None Aug 04 05:40:56.547309 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Identity-Status: Confirmed Aug 04 05:40:56.547309 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Is-Admin-Project: True Aug 04 05:40:56.547309 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Project-Domain-Id: default Aug 04 05:40:56.547309 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Project-Domain-Name: Default Aug 04 05:40:56.547309 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Project-Id: c37bea771e9a4c26a19ff2ea9ed9d9b4 Aug 04 05:40:56.547309 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Project-Name: tempest-TestVolumeBootPattern-525009811 Aug 04 05:40:56.547309 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Role: member,reader Aug 04 05:40:56.547309 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Roles: member,reader Aug 04 05:40:56.548842 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/c37bea771e9a4c26a19ff2ea9ed9d9b4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/c37bea771e9a4c26a19ff2ea9ed9d9b4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_c37bea771e9a4c26a19ff2ea9ed9d9b4", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/c37bea771e9a4c26a19ff2ea9ed9d9b4"}]}] Aug 04 05:40:56.548842 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Tenant: tempest-TestVolumeBootPattern-525009811 Aug 04 05:40:56.548842 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Tenant-Id: c37bea771e9a4c26a19ff2ea9ed9d9b4 Aug 04 05:40:56.548842 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Tenant-Name: tempest-TestVolumeBootPattern-525009811 Aug 04 05:40:56.548842 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-User: tempest-TestVolumeBootPattern-525009811-project Aug 04 05:40:56.548842 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-User-Domain-Id: default Aug 04 05:40:56.548842 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-User-Domain-Name: Default Aug 04 05:40:56.548842 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-User-Id: 5ffe04946139486bb4b976cb0503e0aa Aug 04 05:40:56.548842 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-User-Name: tempest-TestVolumeBootPattern-525009811-project Aug 04 05:40:56.548842 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: method: > Aug 04 05:40:56.548842 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: exception: Instance b9957ec5-1fe1-4a2d-9fdc-dbfa8e3eb9da could not be found. Aug 04 05:40:56.548842 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: action_args: {'id': 'b9957ec5-1fe1-4a2d-9fdc-dbfa8e3eb9da'} Aug 04 05:40:56.549642 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 05:40:56.549642 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:40:56.549642 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 05:40:56.549642 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 05:40:56.549642 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 05:40:56.549642 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 05:40:56.549642 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 05:40:56.549642 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 05:40:56.549642 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 05:40:56.549642 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 05:40:56.549642 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b9957ec5-1fe1-4a2d-9fdc-dbfa8e3eb9da could not be found. Aug 04 05:40:56.549642 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Aug 04 05:40:56.549642 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:40:56.549642 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Aug 04 05:40:56.549642 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:40:56.549642 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:40:56.549642 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:40:56.549642 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 05:40:56.549642 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 05:40:56.549642 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 05:40:56.551028 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 05:40:56.551028 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 05:40:56.551028 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 05:40:56.551028 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 05:40:56.551028 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 05:40:56.551028 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 05:40:56.551028 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 05:40:56.551028 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b9957ec5-1fe1-4a2d-9fdc-dbfa8e3eb9da could not be found. Aug 04 05:40:56.551028 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Aug 04 05:40:56.551028 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:40:56.551028 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Aug 04 05:40:56.551028 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:40:56.551028 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:40:56.551028 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:40:56.551028 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 05:40:56.551028 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 05:40:56.551028 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b9957ec5-1fe1-4a2d-9fdc-dbfa8e3eb9da could not be found. Aug 04 05:40:56.551028 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Aug 04 05:40:56.552219 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-64aabfc9-b152-4faf-842c-a25d981f5362 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Returning 404 to user: Instance b9957ec5-1fe1-4a2d-9fdc-dbfa8e3eb9da could not be found. {{(pid=118477) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 05:40:56.552219 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-64aabfc9-b152-4faf-842c-a25d981f5362 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] 10.222.0.46 "GET /compute/v2.1/servers/b9957ec5-1fe1-4a2d-9fdc-dbfa8e3eb9da" status: 404 len: 111 microversion: 2.1 time: 0.031662 Aug 04 05:40:56.552219 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 571/1125] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:40:56 2022] GET /compute/v2.1/servers/b9957ec5-1fe1-4a2d-9fdc-dbfa8e3eb9da => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 05:41:00.057122 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-4740e3b2-88d9-4e59-b438-6ba910294502 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:41:00.057639 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-4740e3b2-88d9-4e59-b438-6ba910294502 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] [instance: 35bc6986-6c52-4aee-9562-686789af824b] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:41:00.059394 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [req-c034cf62-1a9a-496c-924c-5c900f0539e7 req-a42b5f6f-e44c-4db2-8cc6-b429954ea67c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "35bc6986-6c52-4aee-9562-686789af824b", "tag": "2afdfa4e-8c47-4ac7-a538-6e17137acea1"}]} {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:41:00.064181 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-4740e3b2-88d9-4e59-b438-6ba910294502 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:41:00.064635 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-4740e3b2-88d9-4e59-b438-6ba910294502 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:41:00.065398 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-4740e3b2-88d9-4e59-b438-6ba910294502 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:41:00.066080 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-4740e3b2-88d9-4e59-b438-6ba910294502 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:41:00.071097 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [req-c034cf62-1a9a-496c-924c-5c900f0539e7 req-a42b5f6f-e44c-4db2-8cc6-b429954ea67c service nova] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:41:00.071545 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [req-c034cf62-1a9a-496c-924c-5c900f0539e7 req-a42b5f6f-e44c-4db2-8cc6-b429954ea67c service nova] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:41:00.082873 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.compute.server_external_events [req-c034cf62-1a9a-496c-924c-5c900f0539e7 req-a42b5f6f-e44c-4db2-8cc6-b429954ea67c service nova] Creating event network-changed:2afdfa4e-8c47-4ac7-a538-6e17137acea1 for instance 35bc6986-6c52-4aee-9562-686789af824b on hv-cinder-85207 Aug 04 05:41:00.088656 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [req-c034cf62-1a9a-496c-924c-5c900f0539e7 req-a42b5f6f-e44c-4db2-8cc6-b429954ea67c service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032964 Aug 04 05:41:00.089248 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 572/1126] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Aug 4 05:41:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 05:41:00.091990 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-4740e3b2-88d9-4e59-b438-6ba910294502 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] [instance: 35bc6986-6c52-4aee-9562-686789af824b] Going to try to terminate instance {{(pid=118476) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 05:41:00.320562 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-4740e3b2-88d9-4e59-b438-6ba910294502 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] 10.222.0.46 "DELETE /compute/v2.1/servers/35bc6986-6c52-4aee-9562-686789af824b" status: 204 len: 0 microversion: 2.1 time: 0.267222 Aug 04 05:41:00.321416 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 555/1127] 10.222.0.46 () {58 vars in 1239 bytes} [Thu Aug 4 05:41:00 2022] DELETE /compute/v2.1/servers/35bc6986-6c52-4aee-9562-686789af824b => generated 0 bytes in 270 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 05:41:00.330224 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-8247bd6e-8062-4ea9-b113-9bac950f8d00 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:41:00.331266 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-8247bd6e-8062-4ea9-b113-9bac950f8d00 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] [instance: 35bc6986-6c52-4aee-9562-686789af824b] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:41:00.337930 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-8247bd6e-8062-4ea9-b113-9bac950f8d00 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:41:00.338400 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-8247bd6e-8062-4ea9-b113-9bac950f8d00 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:41:00.339377 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-8247bd6e-8062-4ea9-b113-9bac950f8d00 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:41:00.339801 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-8247bd6e-8062-4ea9-b113-9bac950f8d00 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:41:00.474734 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-8247bd6e-8062-4ea9-b113-9bac950f8d00 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ffe04946139486bb4b976cb0503e0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c37bea771e9a4c26a19ff2ea9ed9d9b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:41:00.482945 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-8247bd6e-8062-4ea9-b113-9bac950f8d00 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] 10.222.0.46 "GET /compute/v2.1/servers/35bc6986-6c52-4aee-9562-686789af824b" status: 200 len: 1575 microversion: 2.1 time: 0.156898 Aug 04 05:41:00.483514 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 573/1128] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:41:00 2022] GET /compute/v2.1/servers/35bc6986-6c52-4aee-9562-686789af824b => generated 1575 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 05:41:01.505602 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-5cb6ffe9-ba02-429b-be4b-38dfb782eaa0 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:41:01.506357 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-5cb6ffe9-ba02-429b-be4b-38dfb782eaa0 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] [instance: 35bc6986-6c52-4aee-9562-686789af824b] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:41:01.512911 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-5cb6ffe9-ba02-429b-be4b-38dfb782eaa0 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:41:01.513361 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-5cb6ffe9-ba02-429b-be4b-38dfb782eaa0 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:41:01.514126 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-5cb6ffe9-ba02-429b-be4b-38dfb782eaa0 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:41:01.514631 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-5cb6ffe9-ba02-429b-be4b-38dfb782eaa0 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:41:01.718486 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-5cb6ffe9-ba02-429b-be4b-38dfb782eaa0 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ffe04946139486bb4b976cb0503e0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c37bea771e9a4c26a19ff2ea9ed9d9b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:41:01.726531 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-5cb6ffe9-ba02-429b-be4b-38dfb782eaa0 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] 10.222.0.46 "GET /compute/v2.1/servers/35bc6986-6c52-4aee-9562-686789af824b" status: 200 len: 1575 microversion: 2.1 time: 0.224631 Aug 04 05:41:01.727104 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 556/1129] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:41:01 2022] GET /compute/v2.1/servers/35bc6986-6c52-4aee-9562-686789af824b => generated 1575 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:41:02.450674 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [req-7402a90a-9642-45d7-aee7-f19806ac2e02 req-77ae155b-d891-4763-9e9a-79191a9eb24e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "35bc6986-6c52-4aee-9562-686789af824b", "name": "network-vif-deleted", "tag": "2afdfa4e-8c47-4ac7-a538-6e17137acea1"}]} {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:41:02.461678 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [req-7402a90a-9642-45d7-aee7-f19806ac2e02 req-77ae155b-d891-4763-9e9a-79191a9eb24e service nova] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:41:02.463300 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [req-7402a90a-9642-45d7-aee7-f19806ac2e02 req-77ae155b-d891-4763-9e9a-79191a9eb24e service nova] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:41:02.473069 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.compute.server_external_events [req-7402a90a-9642-45d7-aee7-f19806ac2e02 req-77ae155b-d891-4763-9e9a-79191a9eb24e service nova] Creating event network-vif-deleted:2afdfa4e-8c47-4ac7-a538-6e17137acea1 for instance 35bc6986-6c52-4aee-9562-686789af824b on hv-cinder-85207 Aug 04 05:41:02.478969 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [req-7402a90a-9642-45d7-aee7-f19806ac2e02 req-77ae155b-d891-4763-9e9a-79191a9eb24e service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031956 Aug 04 05:41:02.479779 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 574/1130] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Aug 4 05:41:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:41:02.748822 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-d6d74050-5c48-4704-a5e8-195c42b33c18 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:41:02.749418 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-d6d74050-5c48-4704-a5e8-195c42b33c18 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] [instance: 35bc6986-6c52-4aee-9562-686789af824b] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:41:02.756222 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-d6d74050-5c48-4704-a5e8-195c42b33c18 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:41:02.756672 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-d6d74050-5c48-4704-a5e8-195c42b33c18 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:41:02.758563 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-d6d74050-5c48-4704-a5e8-195c42b33c18 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:41:02.758798 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-d6d74050-5c48-4704-a5e8-195c42b33c18 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:41:02.826702 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-d6d74050-5c48-4704-a5e8-195c42b33c18 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ffe04946139486bb4b976cb0503e0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c37bea771e9a4c26a19ff2ea9ed9d9b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:41:02.834418 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-d6d74050-5c48-4704-a5e8-195c42b33c18 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] 10.222.0.46 "GET /compute/v2.1/servers/35bc6986-6c52-4aee-9562-686789af824b" status: 200 len: 1225 microversion: 2.1 time: 0.089306 Aug 04 05:41:02.834991 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 557/1131] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:41:02 2022] GET /compute/v2.1/servers/35bc6986-6c52-4aee-9562-686789af824b => generated 1225 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:41:03.857494 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-1a2341c0-76a8-403c-8c08-9e33d8f79a49 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:41:03.858192 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-1a2341c0-76a8-403c-8c08-9e33d8f79a49 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] [instance: 35bc6986-6c52-4aee-9562-686789af824b] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:41:03.864384 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-1a2341c0-76a8-403c-8c08-9e33d8f79a49 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:41:03.864831 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-1a2341c0-76a8-403c-8c08-9e33d8f79a49 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:41:03.865588 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-1a2341c0-76a8-403c-8c08-9e33d8f79a49 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:41:03.866023 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-1a2341c0-76a8-403c-8c08-9e33d8f79a49 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:41:03.879612 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.wsgi [None req-1a2341c0-76a8-403c-8c08-9e33d8f79a49 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] HTTP exception thrown: Instance 35bc6986-6c52-4aee-9562-686789af824b could not be found. Aug 04 05:41:03.881219 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-1a2341c0-76a8-403c-8c08-9e33d8f79a49 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Request method failure captured: Aug 04 05:41:03.881219 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: request: GET /compute/v2.1/servers/35bc6986-6c52-4aee-9562-686789af824b HTTP/1.1 Aug 04 05:41:03.881219 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: Accept: application/json Aug 04 05:41:03.881219 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: Accept-Encoding: identity Aug 04 05:41:03.881219 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: Connection: close Aug 04 05:41:03.881219 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: Content-Length: 0 Aug 04 05:41:03.881219 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: Content-Type: application/json Aug 04 05:41:03.881219 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: Host: 10.222.0.46 Aug 04 05:41:03.881219 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: Openstack-System-Scope: None Aug 04 05:41:03.881219 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: User-Agent: python-urllib3/1.26.11 Aug 04 05:41:03.881219 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Auth-Token: gAAAAABi61pYvx3dS9u4vxk8gLHoxOEk4CNZqQKH6zCkbT29GENfbkkacpdsTIXgj1467iXjea5SO3HK7aggn_GgYiFd0uVYEHt3ICpPoC7qXIDGU8tUx2lDjPs2Inox06ZyU0ZYM8CsnwC6lyX9ku6_UWl_mzqFlVdyHqiHZh9ayVz7tHGScuU Aug 04 05:41:03.881219 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Domain-Id: None Aug 04 05:41:03.881219 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Domain-Name: None Aug 04 05:41:03.881219 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Identity-Status: Confirmed Aug 04 05:41:03.881219 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Is-Admin-Project: True Aug 04 05:41:03.881219 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Project-Domain-Id: default Aug 04 05:41:03.881219 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Project-Domain-Name: Default Aug 04 05:41:03.881219 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Project-Id: c37bea771e9a4c26a19ff2ea9ed9d9b4 Aug 04 05:41:03.881219 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Project-Name: tempest-TestVolumeBootPattern-525009811 Aug 04 05:41:03.881219 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Role: member,reader Aug 04 05:41:03.881219 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Roles: member,reader Aug 04 05:41:03.882968 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/c37bea771e9a4c26a19ff2ea9ed9d9b4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/c37bea771e9a4c26a19ff2ea9ed9d9b4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_c37bea771e9a4c26a19ff2ea9ed9d9b4", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/c37bea771e9a4c26a19ff2ea9ed9d9b4"}]}] Aug 04 05:41:03.882968 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Tenant: tempest-TestVolumeBootPattern-525009811 Aug 04 05:41:03.882968 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Tenant-Id: c37bea771e9a4c26a19ff2ea9ed9d9b4 Aug 04 05:41:03.882968 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Tenant-Name: tempest-TestVolumeBootPattern-525009811 Aug 04 05:41:03.882968 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-User: tempest-TestVolumeBootPattern-525009811-project Aug 04 05:41:03.882968 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-User-Domain-Id: default Aug 04 05:41:03.882968 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-User-Domain-Name: Default Aug 04 05:41:03.882968 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-User-Id: 5ffe04946139486bb4b976cb0503e0aa Aug 04 05:41:03.882968 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-User-Name: tempest-TestVolumeBootPattern-525009811-project Aug 04 05:41:03.882968 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: method: > Aug 04 05:41:03.882968 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: exception: Instance 35bc6986-6c52-4aee-9562-686789af824b could not be found. Aug 04 05:41:03.882968 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: action_args: {'id': '35bc6986-6c52-4aee-9562-686789af824b'} Aug 04 05:41:03.883904 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 05:41:03.883904 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:41:03.883904 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 05:41:03.883904 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 05:41:03.883904 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 05:41:03.883904 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 05:41:03.883904 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 05:41:03.883904 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 05:41:03.883904 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 05:41:03.883904 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 05:41:03.883904 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 35bc6986-6c52-4aee-9562-686789af824b could not be found. Aug 04 05:41:03.883904 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Aug 04 05:41:03.883904 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:41:03.883904 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Aug 04 05:41:03.883904 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:41:03.883904 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:41:03.883904 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:41:03.883904 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 05:41:03.883904 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 05:41:03.883904 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 05:41:03.886212 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 05:41:03.886212 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 05:41:03.886212 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 05:41:03.886212 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 05:41:03.886212 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 05:41:03.886212 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 05:41:03.886212 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 05:41:03.886212 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 35bc6986-6c52-4aee-9562-686789af824b could not be found. Aug 04 05:41:03.886212 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Aug 04 05:41:03.886212 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:41:03.886212 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Aug 04 05:41:03.886212 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:41:03.886212 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:41:03.886212 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:41:03.886212 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 05:41:03.886212 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 05:41:03.886212 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 35bc6986-6c52-4aee-9562-686789af824b could not be found. Aug 04 05:41:03.886212 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Aug 04 05:41:03.887675 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-1a2341c0-76a8-403c-8c08-9e33d8f79a49 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Returning 404 to user: Instance 35bc6986-6c52-4aee-9562-686789af824b could not be found. {{(pid=118477) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 05:41:03.887675 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-1a2341c0-76a8-403c-8c08-9e33d8f79a49 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] 10.222.0.46 "GET /compute/v2.1/servers/35bc6986-6c52-4aee-9562-686789af824b" status: 404 len: 111 microversion: 2.1 time: 0.029917 Aug 04 05:41:03.887675 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 575/1132] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:41:03 2022] GET /compute/v2.1/servers/35bc6986-6c52-4aee-9562-686789af824b => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 05:41:04.375718 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-43a2a8d1-2c3c-49b3-9ade-3b245eb088bc tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:41:04.382229 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-43a2a8d1-2c3c-49b3-9ade-3b245eb088bc tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] [instance: 42569e98-c703-4b76-8988-47029f786567] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:41:04.382647 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-43a2a8d1-2c3c-49b3-9ade-3b245eb088bc tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:41:04.383720 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-43a2a8d1-2c3c-49b3-9ade-3b245eb088bc tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:41:04.384474 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-43a2a8d1-2c3c-49b3-9ade-3b245eb088bc tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:41:04.384913 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-43a2a8d1-2c3c-49b3-9ade-3b245eb088bc tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:41:04.398225 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.wsgi [None req-43a2a8d1-2c3c-49b3-9ade-3b245eb088bc tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] HTTP exception thrown: Instance 42569e98-c703-4b76-8988-47029f786567 could not be found. Aug 04 05:41:04.401824 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-43a2a8d1-2c3c-49b3-9ade-3b245eb088bc tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Request method failure captured: Aug 04 05:41:04.401824 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: request: DELETE /compute/v2.1/servers/42569e98-c703-4b76-8988-47029f786567 HTTP/1.1 Aug 04 05:41:04.401824 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: Accept: application/json Aug 04 05:41:04.401824 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: Accept-Encoding: identity Aug 04 05:41:04.401824 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: Connection: close Aug 04 05:41:04.401824 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: Content-Length: 0 Aug 04 05:41:04.401824 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: Content-Type: application/json Aug 04 05:41:04.401824 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: Host: 10.222.0.46 Aug 04 05:41:04.401824 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: Openstack-System-Scope: None Aug 04 05:41:04.401824 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: User-Agent: python-urllib3/1.26.11 Aug 04 05:41:04.401824 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Auth-Token: gAAAAABi61pYvx3dS9u4vxk8gLHoxOEk4CNZqQKH6zCkbT29GENfbkkacpdsTIXgj1467iXjea5SO3HK7aggn_GgYiFd0uVYEHt3ICpPoC7qXIDGU8tUx2lDjPs2Inox06ZyU0ZYM8CsnwC6lyX9ku6_UWl_mzqFlVdyHqiHZh9ayVz7tHGScuU Aug 04 05:41:04.401824 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Domain-Id: None Aug 04 05:41:04.401824 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Domain-Name: None Aug 04 05:41:04.401824 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Identity-Status: Confirmed Aug 04 05:41:04.401824 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Is-Admin-Project: True Aug 04 05:41:04.401824 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Project-Domain-Id: default Aug 04 05:41:04.401824 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Project-Domain-Name: Default Aug 04 05:41:04.401824 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Project-Id: c37bea771e9a4c26a19ff2ea9ed9d9b4 Aug 04 05:41:04.401824 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Project-Name: tempest-TestVolumeBootPattern-525009811 Aug 04 05:41:04.401824 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Role: member,reader Aug 04 05:41:04.401824 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Roles: member,reader Aug 04 05:41:04.403284 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/c37bea771e9a4c26a19ff2ea9ed9d9b4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/c37bea771e9a4c26a19ff2ea9ed9d9b4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_c37bea771e9a4c26a19ff2ea9ed9d9b4", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/c37bea771e9a4c26a19ff2ea9ed9d9b4"}]}] Aug 04 05:41:04.403284 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Tenant: tempest-TestVolumeBootPattern-525009811 Aug 04 05:41:04.403284 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Tenant-Id: c37bea771e9a4c26a19ff2ea9ed9d9b4 Aug 04 05:41:04.403284 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-Tenant-Name: tempest-TestVolumeBootPattern-525009811 Aug 04 05:41:04.403284 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-User: tempest-TestVolumeBootPattern-525009811-project Aug 04 05:41:04.403284 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-User-Domain-Id: default Aug 04 05:41:04.403284 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-User-Domain-Name: Default Aug 04 05:41:04.403284 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-User-Id: 5ffe04946139486bb4b976cb0503e0aa Aug 04 05:41:04.403284 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: X-User-Name: tempest-TestVolumeBootPattern-525009811-project Aug 04 05:41:04.403284 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: method: > Aug 04 05:41:04.403284 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: exception: Instance 42569e98-c703-4b76-8988-47029f786567 could not be found. Aug 04 05:41:04.403284 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: action_args: {'id': '42569e98-c703-4b76-8988-47029f786567'} Aug 04 05:41:04.404253 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 05:41:04.404253 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:41:04.404253 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 05:41:04.404253 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 05:41:04.404253 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 05:41:04.404253 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 05:41:04.404253 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 05:41:04.404253 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 05:41:04.404253 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 05:41:04.404253 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 05:41:04.404253 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 42569e98-c703-4b76-8988-47029f786567 could not be found. Aug 04 05:41:04.404253 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Aug 04 05:41:04.404253 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:41:04.404253 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Aug 04 05:41:04.404253 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:41:04.404253 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:41:04.404253 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:41:04.404253 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 05:41:04.404253 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 05:41:04.404253 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 05:41:04.406236 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 05:41:04.406236 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 05:41:04.406236 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 05:41:04.406236 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 05:41:04.406236 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 05:41:04.406236 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 05:41:04.406236 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 05:41:04.406236 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 05:41:04.406236 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 05:41:04.406236 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 42569e98-c703-4b76-8988-47029f786567 could not be found. Aug 04 05:41:04.406236 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Aug 04 05:41:04.406236 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:41:04.406236 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Aug 04 05:41:04.406236 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:41:04.406236 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:41:04.406236 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:41:04.406236 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 05:41:04.406236 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 05:41:04.406236 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 42569e98-c703-4b76-8988-47029f786567 could not be found. Aug 04 05:41:04.406236 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Aug 04 05:41:04.407823 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-43a2a8d1-2c3c-49b3-9ade-3b245eb088bc tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Returning 404 to user: Instance 42569e98-c703-4b76-8988-47029f786567 could not be found. {{(pid=118476) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 05:41:04.407823 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-43a2a8d1-2c3c-49b3-9ade-3b245eb088bc tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] 10.222.0.46 "DELETE /compute/v2.1/servers/42569e98-c703-4b76-8988-47029f786567" status: 404 len: 111 microversion: 2.1 time: 0.029866 Aug 04 05:41:04.407823 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 558/1133] 10.222.0.46 () {58 vars in 1239 bytes} [Thu Aug 4 05:41:04 2022] DELETE /compute/v2.1/servers/42569e98-c703-4b76-8988-47029f786567 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 05:41:04.410156 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-c4dc4ccb-ae00-4b10-9987-8cbe0df2b8d8 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:41:04.410820 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-c4dc4ccb-ae00-4b10-9987-8cbe0df2b8d8 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] [instance: 42569e98-c703-4b76-8988-47029f786567] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:41:04.417007 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-c4dc4ccb-ae00-4b10-9987-8cbe0df2b8d8 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:41:04.417432 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-c4dc4ccb-ae00-4b10-9987-8cbe0df2b8d8 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:41:04.418186 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-c4dc4ccb-ae00-4b10-9987-8cbe0df2b8d8 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:41:04.418645 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-c4dc4ccb-ae00-4b10-9987-8cbe0df2b8d8 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Lock "36d37866-0ef0-448b-8699-3d2b86be0706" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:41:04.433823 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.wsgi [None req-c4dc4ccb-ae00-4b10-9987-8cbe0df2b8d8 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] HTTP exception thrown: Instance 42569e98-c703-4b76-8988-47029f786567 could not be found. Aug 04 05:41:04.433823 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-c4dc4ccb-ae00-4b10-9987-8cbe0df2b8d8 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Request method failure captured: Aug 04 05:41:04.433823 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: request: GET /compute/v2.1/servers/42569e98-c703-4b76-8988-47029f786567 HTTP/1.1 Aug 04 05:41:04.433823 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: Accept: application/json Aug 04 05:41:04.433823 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: Accept-Encoding: identity Aug 04 05:41:04.433823 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: Connection: close Aug 04 05:41:04.433823 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: Content-Length: 0 Aug 04 05:41:04.433823 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: Content-Type: application/json Aug 04 05:41:04.433823 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: Host: 10.222.0.46 Aug 04 05:41:04.433823 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: Openstack-System-Scope: None Aug 04 05:41:04.433823 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: User-Agent: python-urllib3/1.26.11 Aug 04 05:41:04.433823 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Auth-Token: gAAAAABi61pYvx3dS9u4vxk8gLHoxOEk4CNZqQKH6zCkbT29GENfbkkacpdsTIXgj1467iXjea5SO3HK7aggn_GgYiFd0uVYEHt3ICpPoC7qXIDGU8tUx2lDjPs2Inox06ZyU0ZYM8CsnwC6lyX9ku6_UWl_mzqFlVdyHqiHZh9ayVz7tHGScuU Aug 04 05:41:04.433823 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Domain-Id: None Aug 04 05:41:04.433823 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Domain-Name: None Aug 04 05:41:04.433823 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Identity-Status: Confirmed Aug 04 05:41:04.433823 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Is-Admin-Project: True Aug 04 05:41:04.433823 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Project-Domain-Id: default Aug 04 05:41:04.433823 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Project-Domain-Name: Default Aug 04 05:41:04.433823 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Project-Id: c37bea771e9a4c26a19ff2ea9ed9d9b4 Aug 04 05:41:04.433823 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Project-Name: tempest-TestVolumeBootPattern-525009811 Aug 04 05:41:04.433823 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Role: member,reader Aug 04 05:41:04.433823 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Roles: member,reader Aug 04 05:41:04.435897 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/c37bea771e9a4c26a19ff2ea9ed9d9b4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/c37bea771e9a4c26a19ff2ea9ed9d9b4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_c37bea771e9a4c26a19ff2ea9ed9d9b4", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/c37bea771e9a4c26a19ff2ea9ed9d9b4"}]}] Aug 04 05:41:04.435897 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Tenant: tempest-TestVolumeBootPattern-525009811 Aug 04 05:41:04.435897 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Tenant-Id: c37bea771e9a4c26a19ff2ea9ed9d9b4 Aug 04 05:41:04.435897 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-Tenant-Name: tempest-TestVolumeBootPattern-525009811 Aug 04 05:41:04.435897 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-User: tempest-TestVolumeBootPattern-525009811-project Aug 04 05:41:04.435897 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-User-Domain-Id: default Aug 04 05:41:04.435897 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-User-Domain-Name: Default Aug 04 05:41:04.435897 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-User-Id: 5ffe04946139486bb4b976cb0503e0aa Aug 04 05:41:04.435897 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: X-User-Name: tempest-TestVolumeBootPattern-525009811-project Aug 04 05:41:04.435897 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: method: > Aug 04 05:41:04.435897 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: exception: Instance 42569e98-c703-4b76-8988-47029f786567 could not be found. Aug 04 05:41:04.435897 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: action_args: {'id': '42569e98-c703-4b76-8988-47029f786567'} Aug 04 05:41:04.436972 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 05:41:04.436972 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:41:04.436972 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 05:41:04.436972 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 05:41:04.436972 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 05:41:04.436972 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 05:41:04.436972 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 05:41:04.436972 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 05:41:04.436972 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 05:41:04.436972 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 05:41:04.436972 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 42569e98-c703-4b76-8988-47029f786567 could not be found. Aug 04 05:41:04.436972 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Aug 04 05:41:04.436972 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:41:04.436972 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Aug 04 05:41:04.436972 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:41:04.436972 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:41:04.436972 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:41:04.436972 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 05:41:04.436972 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 05:41:04.436972 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 05:41:04.438721 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 05:41:04.438721 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 05:41:04.438721 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 05:41:04.438721 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 05:41:04.438721 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 05:41:04.438721 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 05:41:04.438721 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 05:41:04.438721 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 42569e98-c703-4b76-8988-47029f786567 could not be found. Aug 04 05:41:04.438721 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Aug 04 05:41:04.438721 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:41:04.438721 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Aug 04 05:41:04.438721 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:41:04.438721 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:41:04.438721 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:41:04.438721 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 05:41:04.438721 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 05:41:04.438721 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 42569e98-c703-4b76-8988-47029f786567 could not be found. Aug 04 05:41:04.438721 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Aug 04 05:41:04.440205 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-c4dc4ccb-ae00-4b10-9987-8cbe0df2b8d8 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Returning 404 to user: Instance 42569e98-c703-4b76-8988-47029f786567 could not be found. {{(pid=118477) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 05:41:04.440205 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-c4dc4ccb-ae00-4b10-9987-8cbe0df2b8d8 tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] 10.222.0.46 "GET /compute/v2.1/servers/42569e98-c703-4b76-8988-47029f786567" status: 404 len: 111 microversion: 2.1 time: 0.028620 Aug 04 05:41:04.440205 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 576/1134] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Aug 4 05:41:04 2022] GET /compute/v2.1/servers/42569e98-c703-4b76-8988-47029f786567 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 05:41:05.958709 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-9fe4fd5d-aefd-4fd1-8b30-8dd38c4a4a0a tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] Calling method '.version_select at 0x7f1475e74550>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:41:06.029069 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-9fe4fd5d-aefd-4fd1-8b30-8dd38c4a4a0a tempest-TestVolumeBootPattern-525009811 tempest-TestVolumeBootPattern-525009811-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1497229411" status: 202 len: 0 microversion: 2.1 time: 0.074304 Aug 04 05:41:06.029639 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 559/1135] 10.222.0.46 () {58 vars in 1263 bytes} [Thu Aug 4 05:41:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1497229411 => generated 0 bytes in 76 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 05:43:37.188766 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 05:43:37.189341 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: Thu Aug 4 05:43:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 05:43:49.137986 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 05:43:49.138682 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: Thu Aug 4 05:43:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 05:43:53.337620 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 05:43:53.338296 dv-cinder-852072-1-iscsi devstack@n-api.service[118476]: Thu Aug 4 05:43:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 05:43:53.437408 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 05:43:53.437896 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: Thu Aug 4 05:43:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 05:45:08.834642 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 05:45:08.835434 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: Thu Aug 4 05:45:08 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 05:45:16.492957 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 05:45:16.493589 dv-cinder-852072-1-iscsi devstack@n-api.service[118477]: Thu Aug 4 05:45:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!